-- Logs begin at Mon 2022-07-18 09:43:30 UTC, end at Mon 2022-07-18 11:03:13 UTC. -- Jul 18 10:33:50.845826 dv-cinder-846171-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:33:50.854440 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:33:50 2022] *** Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: nodename: dv-cinder-846171-2-iscsi Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: machine: x86_64 Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: clock source: unix Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: pcre jit disabled Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: detected number of CPU cores: 4 Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: current working directory: / Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: your processes number limit is 47680 Jul 18 10:33:50.856462 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: your memory page size is 4096 bytes Jul 18 10:33:50.857331 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: detected max file descriptor number: 2048 Jul 18 10:33:50.857331 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: lock engine: pthread robust mutexes Jul 18 10:33:50.857331 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: thunder lock: enabled Jul 18 10:33:50.857331 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:33:50.857331 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:33:50.897165 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: Python main interpreter initialized at 0x5594692159c0 Jul 18 10:33:50.897165 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: python threads support enabled Jul 18 10:33:50.897165 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: your server socket listen backlog is limited to 100 connections Jul 18 10:33:50.897165 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:33:50.897520 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:33:50.897595 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: *** Operational MODE: preforking *** Jul 18 10:33:50.897826 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:33:50.897826 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: spawned uWSGI master process (pid: 110288) Jul 18 10:33:50.898044 dv-cinder-846171-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:33:50.898621 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: spawned uWSGI worker 1 (pid: 110289, cores: 1) Jul 18 10:33:50.899046 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: spawned uWSGI worker 2 (pid: 110290, cores: 1) Jul 18 10:33:50.899202 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:33:51.571276 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:33:51.575757 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:33:52.672379 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:33:52.672379 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: from cryptography.utils import int_from_bytes Jul 18 10:33:52.673042 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:33:52.673042 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: from cryptography.utils import int_from_bytes Jul 18 10:33:52.673848 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:33:52.673848 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: from cryptography.utils import int_from_bytes Jul 18 10:33:52.674281 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:33:52.674281 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: from cryptography.utils import int_from_bytes Jul 18 10:33:55.167963 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:33:55.168632 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:33:55.169033 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:33:55.169133 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:33:55.169227 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:33:55.169312 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:33:55.169397 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:33:55.169397 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:33:55.169549 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:33:55.169549 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:33:55.169672 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.169938 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170046 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170264 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170357 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170572 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170681 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170892 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.170984 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171192 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171286 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171504 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171602 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171816 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.171907 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172132 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172222 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172406 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172490 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172724 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.172811 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173046 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173142 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-2-iscsi {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173359 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173442 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-2-iscsi {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173662 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173753 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.173966 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174056 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174273 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174369 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174571 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174677 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174883 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.174974 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.175180 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.175282 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.175494 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.175669 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.176001 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.176154 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.176315 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.176959 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.177538 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.177682 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.177682 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.177933 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178057 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178184 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178301 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178421 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178610 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178737 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.178933 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179071 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179246 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179371 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179572 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179697 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.179883 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180018 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-2-iscsi {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180270 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180400 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-2-iscsi {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180585 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180722 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.180927 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181064 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181363 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181621 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181754 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.181925 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182049 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182238 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182377 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182552 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182677 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182854 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.182979 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183178 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183316 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183493 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183619 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183806 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.183937 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184119 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184263 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184417 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184543 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184764 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.184890 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185022 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185151 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185325 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185457 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185625 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185750 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.185925 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186057 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186186 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186308 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186458 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186582 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186762 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.186893 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187072 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187203 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187395 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187512 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187720 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187851 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.187983 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188105 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188300 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188442 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188570 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188720 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188872 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.188993 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189128 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189250 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189429 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189556 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189739 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.189871 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190050 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190176 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190354 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190483 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190660 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190783 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.190958 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191088 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191262 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191392 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191566 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191698 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.191879 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.192004 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.192942 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.193364 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.193489 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.193626 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.193753 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.193875 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194004 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194125 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194254 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194384 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194558 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194684 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.194897 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195030 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195189 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195329 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195502 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195625 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195813 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.195938 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196118 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196253 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196419 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196544 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196742 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.196872 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197055 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197181 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197379 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197504 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197696 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197827 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.197962 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198094 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198222 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198351 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198512 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198646 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198824 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.198950 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199121 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199250 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199422 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199560 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199723 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.199848 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200017 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200150 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200314 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200446 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200623 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200829 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.200952 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201072 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201227 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201361 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201528 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201652 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201828 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.201989 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202113 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202243 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202412 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202537 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202711 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.202836 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203014 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203147 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203328 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203459 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203630 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203767 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.203930 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204056 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204230 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204364 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204533 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204665 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.204942 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205089 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205213 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205335 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205462 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205584 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205764 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.205898 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206085 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206210 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206386 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206512 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206689 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206822 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.206986 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.207162 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.207285 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.207413 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.207582 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.207732 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.208615 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.208615 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.208897 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209021 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209151 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209282 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209459 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209587 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209785 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.209915 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210079 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210214 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210407 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210542 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210709 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.210833 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211011 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211135 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211315 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211439 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211616 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211752 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.211914 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212038 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212209 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212333 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212523 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212661 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212860 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.212985 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213166 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213290 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213468 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213601 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213767 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.213899 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.214087 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:33:55.214213 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.214416 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.214554 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.214744 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.214866 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215087 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215214 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215412 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215545 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215689 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.215846 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216008 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216318 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216439 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216625 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216781 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.216960 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217087 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217275 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217411 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217579 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217710 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.217886 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218021 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218194 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218318 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218507 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218633 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218820 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.218949 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219136 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219294 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219446 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219576 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219758 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.219884 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220066 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220191 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220368 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220498 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220698 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.220840 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221028 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221152 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221338 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221648 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221786 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.221985 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222112 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222299 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222422 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222615 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222748 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.222931 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.223054 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.223260 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.223895 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.224485 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.224616 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.224773 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.224899 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225021 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225230 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225365 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225495 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225618 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225728 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225848 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.225977 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226107 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226232 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226353 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226474 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226595 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226716 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226858 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.226987 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227109 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227296 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227424 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227605 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227739 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.227937 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228064 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228248 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228375 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228561 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228749 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228874 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.228996 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229189 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229316 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229497 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229624 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229803 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.229928 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230107 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230232 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230405 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230533 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230705 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.230831 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231003 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231146 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231307 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231433 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231607 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231732 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.231921 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232058 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232239 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232372 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232543 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232668 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.232882 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233026 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233182 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233306 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233488 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233621 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233789 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.233921 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234089 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234213 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234394 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234519 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234697 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234830 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.234999 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235124 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235307 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235441 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235612 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235712 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.235913 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236010 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236311 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236519 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236614 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236841 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.236938 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237141 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237239 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237452 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237548 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237761 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.237849 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238068 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238165 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238378 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238467 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238685 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.238778 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.239545 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240006 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240165 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240311 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240442 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240569 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240710 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240859 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.240990 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241128 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241255 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241427 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241556 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241751 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.241889 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242060 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242188 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242368 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242496 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242667 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242796 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.242970 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243107 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243269 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243408 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243570 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243697 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.243868 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244003 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244169 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244306 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244472 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244599 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244796 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.244937 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245095 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245234 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245524 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245700 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245805 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.245999 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246103 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246302 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246396 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246602 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246708 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.246901 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247005 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247198 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247534 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247637 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247834 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.247929 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248175 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248352 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248506 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248647 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248839 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.248982 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249129 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249270 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249409 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249548 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249696 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.249837 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250001 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250147 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250297 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250444 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250590 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250730 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.250868 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251019 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251185 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251351 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251494 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251631 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251792 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.251939 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252088 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252251 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252398 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252546 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252730 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.252888 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253028 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253175 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253321 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253461 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253600 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253738 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.253899 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254053 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254210 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254357 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254584 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254741 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.254889 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.255094 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.255304 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.255451 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.255690 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.255844 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256020 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256166 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256314 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256472 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256619 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256789 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.256941 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257081 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257226 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257364 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257509 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257647 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.257932 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258069 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258206 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258354 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258500 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258646 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258786 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.258923 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259060 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259205 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259352 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259491 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259636 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259782 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.259921 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260068 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260214 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260353 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260503 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260642 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260821 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.260962 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261112 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261252 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261398 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261537 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261682 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.261862 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262032 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262175 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262313 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262450 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262596 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262746 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.262886 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263025 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263163 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263301 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263438 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263584 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263730 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.263882 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264022 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264167 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264313 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264460 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264607 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264778 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.264922 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.265061 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.265203 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.265997 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266147 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266307 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266454 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266602 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266742 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.266893 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267042 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267183 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267321 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267538 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267680 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267819 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.267957 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268103 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268254 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268401 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268540 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.268894 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269043 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269183 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269337 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269484 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269623 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269770 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.269910 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270057 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270223 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270393 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270581 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270732 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.270921 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271075 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271215 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271355 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271493 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271631 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271631 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.271909 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272064 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272204 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272349 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272498 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272637 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272811 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.272952 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273091 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273229 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273367 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273519 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273659 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273798 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.273946 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274085 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274231 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274383 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274530 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274670 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274808 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.274946 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275085 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275231 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275378 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275519 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275664 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275813 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.275967 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276195 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276341 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276479 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276619 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276800 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.276923 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277014 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277095 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277174 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277253 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277340 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277430 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277517 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277692 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.277783 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278038 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278140 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278350 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278451 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278672 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278775 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.278971 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279065 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279270 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279358 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279577 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279665 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279877 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.279971 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280180 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280266 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280478 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280566 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280805 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.280896 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281107 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281195 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281408 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281507 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281704 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.281800 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282002 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282088 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282311 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282405 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282610 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282696 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.282916 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283001 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283302 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283530 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283617 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283832 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.283930 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284129 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284226 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284431 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284516 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284760 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.284861 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.285110 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.285198 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.285432 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.285518 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.286268 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.286397 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.286611 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.286803 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.286948 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287249 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287350 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287545 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287637 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287862 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.287948 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288163 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288258 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288476 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288571 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288781 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.288872 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289088 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289193 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289391 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289478 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289687 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289775 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.289990 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290087 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290306 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290621 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290707 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.290933 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291022 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291245 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291330 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291546 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291630 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291841 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.291934 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292146 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292238 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292446 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292530 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292767 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.292857 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293065 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293163 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293365 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293452 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293662 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293748 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.293959 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294045 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294260 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294362 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294554 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294647 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294860 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.294944 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295154 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295247 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295453 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295549 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295757 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.295873 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296057 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296171 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296368 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296574 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296750 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.296899 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297039 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297191 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297331 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297469 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297621 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297760 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.297906 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298045 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298183 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298321 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298459 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298597 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298744 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.298883 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299021 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299159 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299297 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299446 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299592 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299740 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.299880 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300032 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300173 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300311 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300457 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300597 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300782 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.300936 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.301077 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.301228 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.301391 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302236 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302389 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302536 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302681 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302838 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.302999 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303146 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303298 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303444 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303589 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303743 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.303913 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304067 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304214 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304367 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304514 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304668 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304841 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.304994 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305143 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305288 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305445 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305592 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305775 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.305936 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306090 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306245 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306547 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306784 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.306936 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307082 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307228 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307381 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307535 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307681 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307826 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.307982 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308128 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308282 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308428 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308579 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308753 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.308905 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309052 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309209 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309357 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309501 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309646 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.309915 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310102 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310253 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310398 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310543 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310690 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310834 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.310988 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311135 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311287 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311434 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311579 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.311724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312021 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312167 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312313 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312457 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312609 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312795 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.312944 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313089 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313234 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313379 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313533 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313679 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313825 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.313979 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314125 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314270 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314424 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314570 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314715 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.314860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315015 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315161 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315314 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315461 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315607 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315762 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.315907 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316052 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316359 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316506 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316651 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.316902 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317082 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317388 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317535 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317680 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.317846 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318001 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318148 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318148 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318434 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318581 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318727 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.318880 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319034 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319180 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319332 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319485 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319632 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.319862 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320012 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320164 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320318 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320472 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320628 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320829 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.320977 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321122 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321267 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321412 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321565 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321724 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.321870 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322015 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322160 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322305 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322463 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322609 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322763 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.322909 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323054 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323199 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323357 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323503 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323667 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323821 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323967 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.323967 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.324259 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.324413 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.324559 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.324732 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.324886 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325054 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325203 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325348 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325492 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325492 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325778 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.325933 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326079 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326079 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326362 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326362 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326639 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.326793 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327025 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327025 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327308 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327472 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327627 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327782 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.327937 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328082 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328235 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328393 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328552 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328753 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.328931 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329092 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329239 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329391 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329556 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329702 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.329920 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330068 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330213 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330358 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330511 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330657 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330811 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.330957 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331105 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331250 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331395 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331551 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331708 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.331856 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332008 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332155 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332301 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332454 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332600 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332784 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.332934 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333080 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333482 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333647 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333794 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333939 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.333939 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334217 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334361 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334515 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334661 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334805 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.334956 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335106 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335251 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335406 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335569 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335723 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.335869 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336021 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336175 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336334 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336481 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336625 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.336842 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337008 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337169 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337316 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337462 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337625 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337772 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.337924 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338082 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338236 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338381 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338527 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338672 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338816 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.338816 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339101 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339246 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339390 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339550 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339704 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.339861 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340015 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340169 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340315 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340459 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340614 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340800 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.340948 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341093 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341238 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341383 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341548 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341703 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341848 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.341993 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342144 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342290 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342443 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342589 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342735 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.342880 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343033 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343187 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343344 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343489 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343633 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343786 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.343933 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344090 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344236 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344380 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344525 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344696 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.344853 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345170 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345326 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345472 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345626 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345773 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.345926 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346072 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346217 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346362 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346506 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346659 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346806 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.346952 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347096 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347251 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347404 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347562 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347717 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.347863 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.348015 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.348161 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.348836 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349006 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349154 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349306 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349306 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349610 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349757 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.349910 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350064 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350217 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350363 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350508 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350666 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350819 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.350965 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351110 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351256 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351400 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351563 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351709 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351855 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.351999 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352144 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352296 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352450 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352595 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352766 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.352915 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353059 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353363 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353520 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353665 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353817 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.353962 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354120 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354268 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354413 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354557 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354701 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.354846 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355006 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355155 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355155 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355459 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355459 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355751 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.355906 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356052 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356197 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356343 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356488 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356632 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356817 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.356971 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357117 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357272 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357419 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357577 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357734 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.357880 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358025 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358177 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358322 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358541 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358689 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358843 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.358988 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359133 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359296 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359453 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359598 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359743 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.359887 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360032 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360190 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360337 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360482 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360627 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360784 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360880 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.360979 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361072 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361182 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361308 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361494 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361627 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361800 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.361988 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362138 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362291 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362437 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362607 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362758 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.362915 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363061 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363359 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363505 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363651 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.363797 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.364521 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.364741 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.364981 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.365261 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.365410 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.365556 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.365702 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.365858 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366013 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366160 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366305 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366458 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366604 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366760 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.366907 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367053 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367209 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367362 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367508 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367508 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367806 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.367806 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368084 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368230 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368374 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368528 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368673 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.368907 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369089 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369238 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369389 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369544 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369697 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369851 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.369998 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370143 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370295 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370442 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370594 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370740 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.370885 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371079 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371238 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371385 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371530 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371675 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371820 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.371967 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372125 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372272 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372417 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372562 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372730 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.372883 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373051 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373199 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373344 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373495 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373639 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373798 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.373951 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374099 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374244 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374389 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374551 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374706 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.374862 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375007 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375152 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375299 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375502 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375664 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375816 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.375967 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376113 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376259 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376600 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376806 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.376964 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377110 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377256 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377413 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377569 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377722 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.377875 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378020 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378165 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378319 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378474 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378628 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378773 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.378928 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.379074 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.379227 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.379375 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.379578 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.379874 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380032 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380189 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380335 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380481 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380640 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380795 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380888 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.380986 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381081 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381162 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381244 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381354 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381445 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381666 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381763 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.381978 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382136 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382282 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382427 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382596 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382742 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.382894 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383040 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383184 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383328 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383546 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383696 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383842 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.383986 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384138 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384293 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384447 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384604 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384791 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.384940 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385085 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385242 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385390 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385542 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385696 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385842 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.385842 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386130 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386284 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386429 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386584 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386743 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.386901 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387131 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387131 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387573 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387718 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.387876 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388022 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388167 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388328 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388500 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388721 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.388889 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389037 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389244 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389676 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389831 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.389978 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390130 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390284 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390435 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390600 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390747 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.390893 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391038 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391183 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391327 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391480 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391626 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391771 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.391916 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392061 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392206 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392363 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392520 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392672 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.392883 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393031 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393183 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393338 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393484 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393629 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393781 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.393927 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394082 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394230 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394385 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394530 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394676 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394828 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.394983 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395159 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395312 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395458 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395610 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395756 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.395910 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396058 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396204 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396359 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396506 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396670 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396844 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.396990 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397136 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397281 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397586 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397733 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.397879 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398032 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398190 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398337 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398490 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398637 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398782 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.398927 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399073 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399227 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399382 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399528 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399673 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399820 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.399990 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400146 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400295 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400440 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400593 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400787 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.400939 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401102 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401249 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401396 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401549 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401701 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.401855 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402019 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402166 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402345 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402496 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402642 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402796 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.402949 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403096 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403241 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403387 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403533 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403687 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.403852 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404006 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404152 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404152 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404435 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404582 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404748 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.404899 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405054 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405208 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405366 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405513 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405666 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405822 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.405976 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406122 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406275 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406421 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406573 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406721 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.406866 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407011 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407168 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407323 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407470 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407615 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407770 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.407932 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.408086 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.408232 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.408377 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.408522 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.408879 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409047 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409196 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409342 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409487 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409638 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.409858 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.410017 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.410176 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.410323 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.410468 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.410619 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.411293 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.411461 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.411608 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.411761 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.411908 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412053 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412365 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412510 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412510 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412827 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.412974 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413131 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413277 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413422 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413567 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413712 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.413856 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414010 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414155 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414310 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414455 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414600 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414745 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.414904 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415052 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415197 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415342 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415486 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415713 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415862 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.415862 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416160 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416318 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416465 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416623 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416811 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.416968 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417057 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417138 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417218 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417314 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417398 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417486 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417567 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417655 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417757 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417839 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.417933 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418058 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418149 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418237 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418327 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418538 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418688 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418844 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.418979 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419150 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419301 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419440 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419578 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419744 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.419890 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420056 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420196 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420362 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420500 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420666 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.420859 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421013 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421149 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421285 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421421 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421592 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421730 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.421901 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422038 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422201 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422339 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422516 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422668 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422824 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.422982 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423128 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423273 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423420 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423574 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423720 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.423865 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424018 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424163 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424339 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424503 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424650 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424846 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.424995 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.425147 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.425294 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110290) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:33:55.425451 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.425605 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.425920 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.426265 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.426702 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.427024 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.427343 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.427652 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:33:55.427897 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110289) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:33:55.491087 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO dbcounter [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Registered counter for database nova_api Jul 18 10:33:55.493390 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO dbcounter [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Registered counter for database nova_api Jul 18 10:33:55.604031 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_db.sqlalchemy.engines [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.608778 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_db.sqlalchemy.engines [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.610569 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writer thread running {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.615390 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writer thread running {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.667106 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.context [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a78ea71-f9a3-4be8-8869-eba1a93328a9(cell1) {{(pid=110289) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:33:55.670421 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.context [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a78ea71-f9a3-4be8-8869-eba1a93328a9(cell1) {{(pid=110290) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:33:55.671090 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.672633 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.673457 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.674354 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_concurrency.lockutils [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.675579 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.675878 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_concurrency.lockutils [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.676750 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_concurrency.lockutils [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:33:55.677770 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO dbcounter [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Registered counter for database nova_cell0 Jul 18 10:33:55.678823 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_concurrency.lockutils [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110290) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:33:55.680820 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO dbcounter [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Registered counter for database nova_cell0 Jul 18 10:33:55.681603 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO dbcounter [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Registered counter for database nova_cell1 Jul 18 10:33:55.684523 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO dbcounter [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Registered counter for database nova_cell1 Jul 18 10:33:55.689396 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_db.sqlalchemy.engines [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.690398 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_db.sqlalchemy.engines [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.693283 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_db.sqlalchemy.engines [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.694477 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_db.sqlalchemy.engines [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.697940 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writer thread running {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.699222 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writer thread running {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.700442 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writer thread running {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.703120 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writer thread running {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.844514 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO dbcounter [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Registered counter for database nova_cell0 Jul 18 10:33:55.847588 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO dbcounter [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Registered counter for database nova_cell0 Jul 18 10:33:55.853652 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_db.sqlalchemy.engines [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110289) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.856987 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG oslo_db.sqlalchemy.engines [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110290) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:33:55.858054 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writer thread running {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:55.861400 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writer thread running {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:33:56.283780 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: WARNING keystonemiddleware.auth_token [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:33:56.291652 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: WARNING keystonemiddleware.auth_token [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:33:56.304409 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: WARNING keystonemiddleware.auth_token [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:33:56.311815 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: WARNING keystonemiddleware.auth_token [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:33:56.635526 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: WARNING keystonemiddleware.auth_token [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:33:56.641424 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: WARNING keystonemiddleware.auth_token [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:33:56.647384 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594692159c0 pid: 110289 (default app) Jul 18 10:33:56.649449 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:33:56.650672 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] 10.222.0.47 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Jul 18 10:33:56.651087 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 1/1] 10.222.0.47 () {50 vars in 788 bytes} [Mon Jul 18 10:33:56 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:33:56.652198 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: WARNING keystonemiddleware.auth_token [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:33:56.658188 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: WARNING keystonemiddleware.auth_token [None req-1ceab5f4-69d0-475b-810c-0e1394d37548 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:33:56.663996 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594692159c0 pid: 110290 (default app) Jul 18 10:35:16.760426 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:16.761466 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 18 10:35:16.761857 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 2/2] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:16.778171 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_api:SELECT=3 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:16.779401 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_cell0:SELECT=3 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:16.780728 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_cell1:SELECT=3 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:16.781513 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:17.632196 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-c1802ee4-0e40-4598-bb1a-7a66e2cc90ac admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:17.661901 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-c1802ee4-0e40-4598-bb1a-7a66e2cc90ac admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.893188 Jul 18 10:35:17.662801 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 1/3] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Jul 18 10:35:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:19.919213 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:19.920205 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-4257f153-862c-4341-bf78-fe27a002eedd None None] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 18 10:35:19.920818 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 3/4] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:20.397804 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-da7910e4-6e85-4d27-9598-d29a5f2d0d2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "cirros256", "ram": 256, "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:20.418334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:35:20.418334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: warnings.warn(msg) Jul 18 10:35:20.536399 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-da7910e4-6e85-4d27-9598-d29a5f2d0d2f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.608504 Jul 18 10:35:20.552961 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 2/5] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:20.555225 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_api:SELECT=3 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:20.556708 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_cell1:SELECT=3 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:20.558062 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_cell0:SELECT=3 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:20.558575 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:20.785092 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-371b05bd-ffd2-4899-a62e-797fbb97acaa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:20.788206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:35:20.788206 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:35:20.959742 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-371b05bd-ffd2-4899-a62e-797fbb97acaa admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.412224 Jul 18 10:35:20.973539 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 4/6] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Jul 18 10:35:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:23.215081 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-da7910e4-6e85-4d27-9598-d29a5f2d0d2f admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:23.216819 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-da7910e4-6e85-4d27-9598-d29a5f2d0d2f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002173 Jul 18 10:35:23.217426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 3/7] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:23.871277 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-55e7fc03-1149-46cb-a4b9-428693c30fd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1", "disk": 5}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:23.892657 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:35:23.892657 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:35:24.032235 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-55e7fc03-1149-46cb-a4b9-428693c30fd3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.808010 Jul 18 10:35:24.033566 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 5/8] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:24.045328 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-bd6fd96c-b0cb-4747-95ba-5bf3ae2d3ca9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:24.046807 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:35:24.046807 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: warnings.warn(msg) Jul 18 10:35:24.170840 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-bd6fd96c-b0cb-4747-95ba-5bf3ae2d3ca9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129038 Jul 18 10:35:24.171697 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 4/9] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Jul 18 10:35:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:26.430767 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-55e7fc03-1149-46cb-a4b9-428693c30fd3 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:26.432265 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-55e7fc03-1149-46cb-a4b9-428693c30fd3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002498 Jul 18 10:35:26.432668 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 6/10] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:26.846070 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-81fcee58-f105-412a-8ba0-21309452d04f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "disk": 10, "rxtx_factor": 1.0, "id": "d2"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:26.949986 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-81fcee58-f105-412a-8ba0-21309452d04f admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.509406 Jul 18 10:35:26.950600 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 5/11] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:26.963325 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-8931666b-ca66-452c-85c9-965fd6e36cd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:27.188137 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-8931666b-ca66-452c-85c9-965fd6e36cd1 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.228461 Jul 18 10:35:27.188984 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 7/12] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Jul 18 10:35:26 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:29.399269 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-81fcee58-f105-412a-8ba0-21309452d04f admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:29.401335 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-81fcee58-f105-412a-8ba0-21309452d04f admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002243 Jul 18 10:35:29.401761 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 6/13] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:29.951455 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-2ab62ccf-2d2e-421b-ba98-ecc19fa036fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:30.035968 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-2ab62ccf-2d2e-421b-ba98-ecc19fa036fe admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.627049 Jul 18 10:35:30.036731 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 8/14] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:30.048995 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-5c5774a3-f140-41db-8f4d-c2382e27aa61 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:30.278923 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-5c5774a3-f140-41db-8f4d-c2382e27aa61 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.234048 Jul 18 10:35:30.279701 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 7/15] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Jul 18 10:35:30 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:32.513696 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-2ab62ccf-2d2e-421b-ba98-ecc19fa036fe admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:32.514698 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-2ab62ccf-2d2e-421b-ba98-ecc19fa036fe admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 18 10:35:32.515108 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 9/16] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:32.965061 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "vcpus": 4}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:33.110253 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.588933 Jul 18 10:35:33.110963 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 8/17] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:35:33.123634 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-fc23edc7-5423-4464-82ce-fd955618893e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:33.212263 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-fc23edc7-5423-4464-82ce-fd955618893e admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092199 Jul 18 10:35:33.213193 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 10/18] 10.222.0.47 () {64 vars in 1335 bytes} [Mon Jul 18 10:35:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:35.472976 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:35.474000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Jul 18 10:35:35.474408 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 9/19] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:35.898303 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-0ab0de7a-acf0-4315-afdc-1e4fd5d9ad15 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:35.927154 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-0ab0de7a-acf0-4315-afdc-1e4fd5d9ad15 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.446474 Jul 18 10:35:35.927963 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 11/20] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Jul 18 10:35:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:35:38.156697 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:38.158116 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-afc5fc5a-ce64-4f99-a09a-e831fd973566 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Jul 18 10:35:38.158599 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 10/21] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:35:38.605199 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-103bfe8e-852d-4d79-8830-2a73ef3c0f59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "vcpus": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:38.682232 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-103bfe8e-852d-4d79-8830-2a73ef3c0f59 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.516420 Jul 18 10:35:38.683660 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 12/22] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:35:38.697629 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-b1c4ccf1-ab92-4c93-bc95-247a89091559 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:38.793490 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-b1c4ccf1-ab92-4c93-bc95-247a89091559 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.100675 Jul 18 10:35:38.794244 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 11/23] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Jul 18 10:35:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:35:40.997225 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-103bfe8e-852d-4d79-8830-2a73ef3c0f59 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:40.998258 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-103bfe8e-852d-4d79-8830-2a73ef3c0f59 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Jul 18 10:35:40.998656 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 13/24] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:41.417331 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-e3ca5754-05d9-4467-a5d5-91f831dc23b4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "ram": 2048, "id": "2"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:41.544142 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-e3ca5754-05d9-4467-a5d5-91f831dc23b4 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.539673 Jul 18 10:35:41.544725 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 12/25] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:41.557041 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-b3eaa06f-c5b9-45f6-afff-83074c7ce482 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:41.696317 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-b3eaa06f-c5b9-45f6-afff-83074c7ce482 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142994 Jul 18 10:35:41.696847 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 14/26] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Jul 18 10:35:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:43.925223 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-e3ca5754-05d9-4467-a5d5-91f831dc23b4 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:43.926366 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-e3ca5754-05d9-4467-a5d5-91f831dc23b4 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Jul 18 10:35:43.926756 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 13/27] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:44.293327 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-efd2572b-f12e-414f-8da9-96ba1acf09e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "swap": 0, "disk": 40, "os-flavor-access:is_public": true, "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:44.436008 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-efd2572b-f12e-414f-8da9-96ba1acf09e3 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.503362 Jul 18 10:35:44.436972 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 15/28] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:44.450493 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-87853237-5bce-4e18-9b9d-3a72706c2b43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:44.554000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-87853237-5bce-4e18-9b9d-3a72706c2b43 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107592 Jul 18 10:35:44.555071 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 14/29] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Jul 18 10:35:44 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:46.796698 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-efd2572b-f12e-414f-8da9-96ba1acf09e3 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:46.797866 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-efd2572b-f12e-414f-8da9-96ba1acf09e3 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Jul 18 10:35:46.798536 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 16/30] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:47.250178 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-cb1228ea-6f65-4b95-83ea-10dfa32acf4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "vcpus": 4, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "name": "m1.large", "ram": 8192, "rxtx_factor": 1.0}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:47.255773 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:35:47.360583 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-cb1228ea-6f65-4b95-83ea-10dfa32acf4a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.555981 Jul 18 10:35:47.368979 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 15/31] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:47.374172 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-24b397a0-5732-4307-b7d6-005fcd8c41c9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:47.486788 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-24b397a0-5732-4307-b7d6-005fcd8c41c9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.116465 Jul 18 10:35:47.487425 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 17/32] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Jul 18 10:35:47 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:35:49.727731 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-cb1228ea-6f65-4b95-83ea-10dfa32acf4a admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:35:49.728761 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-cb1228ea-6f65-4b95-83ea-10dfa32acf4a admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 10:35:49.742674 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 16/33] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:35:49 2022] GET /compute/v2.1 => generated 388 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:35:50.173195 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "disk": 160, "id": "5", "rxtx_factor": 1.0}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:50.268022 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.528459 Jul 18 10:35:50.269196 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 18/34] 10.222.0.47 () {64 vars in 1282 bytes} [Mon Jul 18 10:35:49 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:35:50.281464 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-58466ee2-dd6f-412f-918f-d5d0c08fe907 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:35:50.421385 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-58466ee2-dd6f-412f-918f-d5d0c08fe907 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.143910 Jul 18 10:35:50.422051 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 17/35] 10.222.0.47 () {64 vars in 1332 bytes} [Mon Jul 18 10:35:50 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:36:11.124360 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:11.125395 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Jul 18 10:36:11.125789 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 19/36] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:36:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:11.521267 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-4d14107e-c7cd-454f-bd40-829e45795861 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:11.540086 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-4d14107e-c7cd-454f-bd40-829e45795861 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407893 Jul 18 10:36:11.540622 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 18/37] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Jul 18 10:36:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:12.628293 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:12.629313 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-e4543a22-177d-407a-adcd-c14f7500da89 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Jul 18 10:36:12.629711 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 20/38] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:13.153597 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-9cfacdea-15e7-4677-adb9-6bfc5c94bfae admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:13.159723 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.wsgi [None req-9cfacdea-15e7-4677-adb9-6bfc5c94bfae admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-9cfacdea-15e7-4677-adb9-6bfc5c94bfae admin admin] Request method failure captured: Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept: application/json Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept-Encoding: gzip, deflate Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Connection: keep-alive Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Content-Length: 0 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Host: 10.222.0.47 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-System-Scope: None Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: User-Agent: python-novaclient Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Auth-Token: gAAAAABi1TecTJqKEcxo5zkNbOKkJhzk_snm2sFL-84ny0grfODBpVvT5Uk5P42lo1gPglDNX1hRhT56XnJ85f2fOJFVEiTsYcCDQj9rSLsa6R_25TogZk7fSX9oZ2VUmnwrx1texzfa95tG8LGneSm_hAcI2IEcaKfHQua1OiACD2mRuzh-C6Q Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Id: None Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Name: None Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Identity-Status: Confirmed Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Is-Admin-Project: True Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Id: default Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Name: Default Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Name: admin Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Role: reader,admin,member Jul 18 10:36:13.163000 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Roles: reader,admin,member Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant: admin Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Name: admin Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User: admin Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Id: default Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Name: Default Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Name: admin Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: method: > Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: exception: Flavor 42 could not be found. Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: action_args: {'id': '42'} Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:13.164724 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:13.165794 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.167334 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-9cfacdea-15e7-4677-adb9-6bfc5c94bfae admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:13.168642 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-9cfacdea-15e7-4677-adb9-6bfc5c94bfae admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397228 Jul 18 10:36:13.168642 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 19/39] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Jul 18 10:36:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:13.174446 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-8dd5b8d3-145f-4a49-9c43-c219500f1b9a admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:13.177366 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:36:13.196116 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-8dd5b8d3-145f-4a49-9c43-c219500f1b9a admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025614 Jul 18 10:36:13.196655 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 21/40] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:13.207174 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-5ea8633d-c217-4fa0-a948-fba66866e869 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:13.228543 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-5ea8633d-c217-4fa0-a948-fba66866e869 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025780 Jul 18 10:36:13.229105 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 20/41] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:13.238366 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-fd1af654-1945-4400-b044-e82f96bfb963 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:13.244331 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.wsgi [None req-fd1af654-1945-4400-b044-e82f96bfb963 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-fd1af654-1945-4400-b044-e82f96bfb963 admin admin] Request method failure captured: Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept: application/json Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept-Encoding: gzip, deflate Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Connection: keep-alive Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Content-Length: 0 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Host: 10.222.0.47 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-System-Scope: None Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: User-Agent: python-novaclient Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Auth-Token: gAAAAABi1TecTJqKEcxo5zkNbOKkJhzk_snm2sFL-84ny0grfODBpVvT5Uk5P42lo1gPglDNX1hRhT56XnJ85f2fOJFVEiTsYcCDQj9rSLsa6R_25TogZk7fSX9oZ2VUmnwrx1texzfa95tG8LGneSm_hAcI2IEcaKfHQua1OiACD2mRuzh-C6Q Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Id: None Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Name: None Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Identity-Status: Confirmed Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Is-Admin-Project: True Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Id: default Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Name: Default Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Name: admin Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Role: reader,admin,member Jul 18 10:36:13.247785 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Roles: reader,admin,member Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant: admin Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Name: admin Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User: admin Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Id: default Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Name: Default Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Name: admin Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: method: > Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: exception: Flavor 42 could not be found. Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: action_args: {'id': '42'} Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:13.249423 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:13.250294 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:13.251322 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-fd1af654-1945-4400-b044-e82f96bfb963 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:13.253227 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-fd1af654-1945-4400-b044-e82f96bfb963 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014334 Jul 18 10:36:13.253227 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 22/42] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Jul 18 10:36:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:14.234991 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-5ea8633d-c217-4fa0-a948-fba66866e869 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.235996 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-5ea8633d-c217-4fa0-a948-fba66866e869 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jul 18 10:36:14.237092 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 21/43] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:14.769071 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4808617b-b784-4930-83d2-28e573e08639 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.774541 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.wsgi [None req-4808617b-b784-4930-83d2-28e573e08639 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4808617b-b784-4930-83d2-28e573e08639 admin admin] Request method failure captured: Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept: application/json Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept-Encoding: gzip, deflate Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Connection: keep-alive Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Content-Length: 0 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Host: 10.222.0.47 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-System-Scope: None Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: User-Agent: python-novaclient Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Auth-Token: gAAAAABi1Tee46h3iX8gzJ9WYC-D-vEq2UNHWEDNx17nKI6EFsmGxGek9Z5cgd75rVFyi1eowq4dh_IXK3WWornwa1oxZi8318tFrhRJ2X1HoY342_3SS1ijoyYQ8DR_wmLESfnl2NpR7IkQwRoknfcGsYv0ml7boEry-56_sx_PARe5Rf4ukXI Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Id: None Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Name: None Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Identity-Status: Confirmed Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Is-Admin-Project: True Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Id: default Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Name: Default Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Name: admin Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Role: reader,admin,member Jul 18 10:36:14.776012 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Roles: reader,admin,member Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant: admin Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Name: admin Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User: admin Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Id: default Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Name: Default Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Name: admin Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: method: > Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: exception: Flavor 84 could not be found. Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: action_args: {'id': '84'} Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:14.777437 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:14.778241 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.779722 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-4808617b-b784-4930-83d2-28e573e08639 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:14.781028 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-4808617b-b784-4930-83d2-28e573e08639 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.402484 Jul 18 10:36:14.781028 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 23/44] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:14.788078 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-6d66a6cc-4317-43b7-a597-f35355c9233c admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.802384 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-6d66a6cc-4317-43b7-a597-f35355c9233c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018994 Jul 18 10:36:14.802908 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 22/45] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:14.812137 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-8fd78318-5d1c-4815-867a-ff7fee0fc60c admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.826589 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-8fd78318-5d1c-4815-867a-ff7fee0fc60c admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017980 Jul 18 10:36:14.827122 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 24/46] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:36:14.837336 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-e7ad1a66-ea1a-4bab-a22c-0913af76de9f admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:14.842753 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.wsgi [None req-e7ad1a66-ea1a-4bab-a22c-0913af76de9f admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-e7ad1a66-ea1a-4bab-a22c-0913af76de9f admin admin] Request method failure captured: Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept: application/json Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept-Encoding: gzip, deflate Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Connection: keep-alive Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Content-Length: 0 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Host: 10.222.0.47 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-System-Scope: None Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: User-Agent: python-novaclient Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Auth-Token: gAAAAABi1Tee46h3iX8gzJ9WYC-D-vEq2UNHWEDNx17nKI6EFsmGxGek9Z5cgd75rVFyi1eowq4dh_IXK3WWornwa1oxZi8318tFrhRJ2X1HoY342_3SS1ijoyYQ8DR_wmLESfnl2NpR7IkQwRoknfcGsYv0ml7boEry-56_sx_PARe5Rf4ukXI Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Id: None Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Name: None Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Identity-Status: Confirmed Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Is-Admin-Project: True Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Id: default Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Name: Default Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Name: admin Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Role: reader,admin,member Jul 18 10:36:14.844266 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Roles: reader,admin,member Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant: admin Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Name: admin Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User: admin Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Id: default Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Name: Default Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Name: admin Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: method: > Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: exception: Flavor 84 could not be found. Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: action_args: {'id': '84'} Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:14.846132 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:14.847044 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:14.848426 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-e7ad1a66-ea1a-4bab-a22c-0913af76de9f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:14.849685 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-e7ad1a66-ea1a-4bab-a22c-0913af76de9f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011840 Jul 18 10:36:14.849685 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 23/47] 10.222.0.47 () {60 vars in 1190 bytes} [Mon Jul 18 10:36:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:15.817633 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-8fd78318-5d1c-4815-867a-ff7fee0fc60c admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:15.818635 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-8fd78318-5d1c-4815-867a-ff7fee0fc60c admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 18 10:36:15.819032 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 25/48] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:16.473053 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2e718977-1557-470e-be58-9ac6af4b7a6e admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:16.478721 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.wsgi [None req-2e718977-1557-470e-be58-9ac6af4b7a6e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2e718977-1557-470e-be58-9ac6af4b7a6e admin admin] Request method failure captured: Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept: application/json Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Accept-Encoding: gzip, deflate Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Connection: keep-alive Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Content-Length: 0 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Host: 10.222.0.47 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Openstack-System-Scope: None Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: User-Agent: python-novaclient Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Auth-Token: gAAAAABi1Tefsudu7VK4eFTM7JZ8ZNswJP6WzuPDrYjtAp4P1ospMLi02NmYT7OaMR9AEvwbLslBQT7JK4F7-yvQmisT5HhSpkiH7eeN39Nl8aP8dRzAv0uz77gfWtytWJyFlGRWuh8Mv7Y4YdvMTV1Eeh4ChUA5eY4shcwCfBH8jektIQ5lq6E Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Id: None Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Domain-Name: None Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Identity-Status: Confirmed Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Is-Admin-Project: True Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Id: default Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Domain-Name: Default Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Project-Name: admin Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Role: reader,admin,member Jul 18 10:36:16.480215 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Roles: reader,admin,member Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant: admin Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-Tenant-Name: admin Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User: admin Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Id: default Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Domain-Name: Default Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: X-User-Name: admin Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: method: > Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: exception: Flavor 451 could not be found. Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: action_args: {'id': '451'} Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:16.481825 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:16.482715 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.483860 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2e718977-1557-470e-be58-9ac6af4b7a6e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110290) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:16.484917 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2e718977-1557-470e-be58-9ac6af4b7a6e admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.519231 Jul 18 10:36:16.484917 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 24/49] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:36:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 520 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:16.491940 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-b335f17d-d255-4c74-9e30-8564c47cd7af admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:16.506058 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-b335f17d-d255-4c74-9e30-8564c47cd7af admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017737 Jul 18 10:36:16.506580 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 26/50] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:36:16.515790 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:16.530799 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018513 Jul 18 10:36:16.531337 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 25/51] 10.222.0.47 () {60 vars in 1210 bytes} [Mon Jul 18 10:36:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:36:16.540738 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-d1177e0b-1297-4996-a98f-c19d31af8a5f admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:16.546377 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.wsgi [None req-d1177e0b-1297-4996-a98f-c19d31af8a5f admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-d1177e0b-1297-4996-a98f-c19d31af8a5f admin admin] Request method failure captured: Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept: application/json Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Accept-Encoding: gzip, deflate Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Connection: keep-alive Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Content-Length: 0 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Host: 10.222.0.47 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-Api-Version: compute 2.90 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Openstack-System-Scope: None Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: User-Agent: python-novaclient Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Auth-Token: gAAAAABi1Tefsudu7VK4eFTM7JZ8ZNswJP6WzuPDrYjtAp4P1ospMLi02NmYT7OaMR9AEvwbLslBQT7JK4F7-yvQmisT5HhSpkiH7eeN39Nl8aP8dRzAv0uz77gfWtytWJyFlGRWuh8Mv7Y4YdvMTV1Eeh4ChUA5eY4shcwCfBH8jektIQ5lq6E Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Id: None Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Domain-Name: None Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Identity-Status: Confirmed Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Is-Admin-Project: True Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Id: default Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Domain-Name: Default Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Project-Name: admin Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Role: reader,admin,member Jul 18 10:36:16.547870 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Roles: reader,admin,member Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/1a98445bbc6b4a039db83aaf6d202161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/1a98445bbc6b4a039db83aaf6d202161"}]}] Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant: admin Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Id: 1a98445bbc6b4a039db83aaf6d202161 Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-Tenant-Name: admin Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User: admin Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Id: default Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Domain-Name: Default Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Id: 02055864266e49b39ebadd610e2d403c Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: X-User-Name: admin Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: method: > Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: exception: Flavor 451 could not be found. Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: action_args: {'id': '451'} Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:36:16.550020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:16.551075 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: ERROR nova.api.openstack.wsgi Jul 18 10:36:16.552462 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-d1177e0b-1297-4996-a98f-c19d31af8a5f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110289) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:36:16.553708 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-d1177e0b-1297-4996-a98f-c19d31af8a5f admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012613 Jul 18 10:36:16.553708 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 27/52] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:36:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 10:36:17.516837 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:17.518516 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002066 Jul 18 10:36:17.518909 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 26/53] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:18.041344 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-6a4512e1-c56e-4ff2-98f2-c6fe05f5ce57 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:36:18.159332 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-6a4512e1-c56e-4ff2-98f2-c6fe05f5ce57 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.501291 Jul 18 10:36:18.159796 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 28/54] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Jul 18 10:36:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:19.133545 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:19.134578 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 18 10:36:19.134974 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 27/55] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:19.661027 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-e0e2f3d3-6075-4228-947c-ee29d51e4b8a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:36:19.730576 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-e0e2f3d3-6075-4228-947c-ee29d51e4b8a admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.454923 Jul 18 10:36:19.731123 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 29/56] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Jul 18 10:36:19 2022] POST /compute/v2.1/flavors => generated 405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:20.696604 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:20.697627 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 18 10:36:20.698014 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 28/57] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:21.223410 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-5e7095b5-eed0-4357-857e-2697067cb5d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:36:21.290482 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-5e7095b5-eed0-4357-857e-2697067cb5d9 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.451372 Jul 18 10:36:21.291032 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 30/58] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Jul 18 10:36:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:22.287884 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:22.288897 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 18 10:36:22.289292 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 29/59] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:22.809202 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-80015e71-30ab-46a7-96cd-ef52b2505744 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:36:22.919958 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-80015e71-30ab-46a7-96cd-ef52b2505744 admin admin] 10.222.0.47 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.491357 Jul 18 10:36:22.920509 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 31/60] 10.222.0.47 () {64 vars in 1235 bytes} [Mon Jul 18 10:36:22 2022] POST /compute/v2.1/flavors => generated 409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:36:23.905942 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:23.906935 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 18 10:36:23.907328 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 30/61] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:36:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:36:24.429216 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-36011111-61a8-4ab4-ac54-60492315c343 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:36:24.448414 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-36011111-61a8-4ab4-ac54-60492315c343 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.402864 Jul 18 10:36:24.448993 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 32/62] 10.222.0.47 () {60 vars in 1202 bytes} [Mon Jul 18 10:36:24 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:16.973050 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:16.974119 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-84037980-e61f-41cc-8693-275161f3baf9 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jul 18 10:37:16.974561 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 31/63] 10.222.0.47 () {54 vars in 930 bytes} [Mon Jul 18 10:37:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:37:16.985058 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:17.363506 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-d2753ef2-cd9e-466a-bf6e-53f54efe433b admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.382199 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-d2753ef2-cd9e-466a-bf6e-53f54efe433b admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.401652 Jul 18 10:37:17.382726 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 33/64] 10.222.0.47 () {60 vars in 1291 bytes} [Mon Jul 18 10:37:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:37:17.403708 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG dbcounter [-] [110290] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110290) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:37:17.408123 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-301a12d7-aaf8-4ce2-957c-25e50bbabdcb admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.415517 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-301a12d7-aaf8-4ce2-957c-25e50bbabdcb admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013279 Jul 18 10:37:17.416041 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 32/65] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Jul 18 10:37:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:17.427402 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-bf7b88c1-13a6-4fdf-a558-3fd1d3caa573 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.435072 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-bf7b88c1-13a6-4fdf-a558-3fd1d3caa573 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011219 Jul 18 10:37:17.435583 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 34/66] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Jul 18 10:37:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:17.446460 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.454723 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011699 Jul 18 10:37:17.455229 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 33/67] 10.222.0.47 () {60 vars in 1285 bytes} [Mon Jul 18 10:37:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:37:17.466452 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-b025e997-2eff-4644-8c6b-c62ef3b41bbf admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:37:17.474837 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-b025e997-2eff-4644-8c6b-c62ef3b41bbf admin admin] 10.222.0.47 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011901 Jul 18 10:37:17.475355 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 35/68] 10.222.0.47 () {60 vars in 1282 bytes} [Mon Jul 18 10:37:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:40:57.671178 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:57.672262 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 18 10:40:57.672664 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 34/69] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:40:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:40:57.813536 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_api:SELECT=6 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:40:57.972204 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:57.973410 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:57.973410 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:40:57.974605 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:40:57.975049 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:40:57.975830 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:40:57.976258 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:40:58.010151 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-f7707401-0c3a-47cc-afd2-5bbf1837c0e2 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.198012 Jul 18 10:40:58.010959 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 36/70] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:40:57 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:40:58.857370 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:58.858441 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 18 10:40:58.858842 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 35/71] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:40:59.056733 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:40:59.057909 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:40:59.057909 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:40:59.059114 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:40:59.059548 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:40:59.060318 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:40:59.060790 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:40:59.083963 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-161d13e2-dc1d-4e46-a129-8fda8d548cf4 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.083937 Jul 18 10:40:59.084453 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 37/72] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:40:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:41:10.328665 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:41:10.329710 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 18 10:41:10.330101 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 36/73] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:41:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:41:10.474537 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_cell0:SELECT=4 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:10.475253 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_cell1:SELECT=4 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:10.475876 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG dbcounter [-] [110289] Writing DB stats nova_api:SELECT=8 {{(pid=110289) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:41:10.524160 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:41:10.526019 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:10.526019 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:41:10.526560 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:41:10.526991 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:41:10.527758 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:41:10.528176 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:41:10.552969 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-64643084-e68b-462b-9406-274fe43760d1 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082743 Jul 18 10:41:10.553507 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 38/74] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:41:10 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:41:11.409887 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: DEBUG nova.api.openstack.wsgi [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] Calling method '>' {{(pid=110290) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:41:11.410889 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: INFO nova.api.openstack.requestlog [None req-2d022d89-5b34-4a7b-aba3-e8bc29987c23 admin admin] 10.222.0.47 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 18 10:41:11.411293 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: [pid: 110290|app: 0|req: 37/75] 10.222.0.47 () {56 vars in 1074 bytes} [Mon Jul 18 10:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:41:11.613317 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG nova.api.openstack.wsgi [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] Calling method '>' {{(pid=110289) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:41:11.614518 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 10:41:11.614518 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: warnings.warn(msg) Jul 18 10:41:11.615765 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:41:11.616217 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:41:11.617893 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:41:11.618020 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: DEBUG oslo_concurrency.lockutils [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110289) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:41:11.641526 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: INFO nova.api.openstack.requestlog [None req-93761cf9-f4b5-4f4c-9e30-27d3dfe7d847 admin admin] 10.222.0.47 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.089181 Jul 18 10:41:11.642203 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: [pid: 110289|app: 0|req: 39/76] 10.222.0.47 () {60 vars in 1193 bytes} [Mon Jul 18 10:41:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:42:08.012434 dv-cinder-846171-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 10:42:08.019632 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: Mon Jul 18 10:42:08 2022 - graceful shutdown triggered... Jul 18 10:42:08.020221 dv-cinder-846171-2-iscsi devstack@n-api.service[110289]: Gracefully killing worker 1 (pid: 110289)... Jul 18 10:42:08.020600 dv-cinder-846171-2-iscsi devstack@n-api.service[110290]: Gracefully killing worker 2 (pid: 110290)... Jul 18 10:42:09.013682 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: worker 1 buried after 1 seconds Jul 18 10:42:09.013927 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: worker 2 buried after 1 seconds Jul 18 10:42:09.013927 dv-cinder-846171-2-iscsi devstack@n-api.service[110288]: goodbye to uWSGI. Jul 18 10:42:09.015229 dv-cinder-846171-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 10:42:09.015804 dv-cinder-846171-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 10:42:09.018605 dv-cinder-846171-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 10:42:09.028806 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 10:42:09 2022] *** Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: nodename: dv-cinder-846171-2-iscsi Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: machine: x86_64 Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: clock source: unix Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: pcre jit disabled Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: detected number of CPU cores: 4 Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: current working directory: / Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: detected binary path: /usr/bin/uwsgi-core Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: your processes number limit is 47680 Jul 18 10:42:09.030772 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: your memory page size is 4096 bytes Jul 18 10:42:09.031527 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: detected max file descriptor number: 2048 Jul 18 10:42:09.031527 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: lock engine: pthread robust mutexes Jul 18 10:42:09.031527 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: thunder lock: enabled Jul 18 10:42:09.031527 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 10:42:09.031527 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 10:42:09.071990 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: Python main interpreter initialized at 0x56047b0229c0 Jul 18 10:42:09.071990 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: python threads support enabled Jul 18 10:42:09.071990 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: your server socket listen backlog is limited to 100 connections Jul 18 10:42:09.071990 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: your mercy for graceful operations on workers is 90 seconds Jul 18 10:42:09.072469 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 10:42:09.072804 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: *** Operational MODE: preforking *** Jul 18 10:42:09.073265 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: *** uWSGI is running in multiple interpreter mode *** Jul 18 10:42:09.073406 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: spawned uWSGI master process (pid: 124822) Jul 18 10:42:09.073734 dv-cinder-846171-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 10:42:09.074313 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: spawned uWSGI worker 1 (pid: 124843, cores: 1) Jul 18 10:42:09.074676 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: spawned uWSGI worker 2 (pid: 124844, cores: 1) Jul 18 10:42:09.074813 dv-cinder-846171-2-iscsi devstack@n-api.service[124822]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 10:42:09.747712 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:42:09.748313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 10:42:10.931421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:42:10.931421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: from cryptography.utils import int_from_bytes Jul 18 10:42:10.932081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:42:10.932081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: from cryptography.utils import int_from_bytes Jul 18 10:42:10.932476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:42:10.932476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: from cryptography.utils import int_from_bytes Jul 18 10:42:10.932603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 10:42:10.932603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: from cryptography.utils import int_from_bytes Jul 18 10:42:13.391706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:42:13.392285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:42:13.392563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:42:13.392888 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:42:13.393144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:42:13.393529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.393854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.394174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.394492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.394818 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.395148 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.395470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.395787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.396114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.396375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.396710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.397111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-2-iscsi {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.397454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.397759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.398071 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.398393 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.398697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.399015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.400045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.400623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402657 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.402938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.403253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.403566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.403877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.404323 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-2-iscsi {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.404665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.405016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.405329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.405746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.406065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.406381 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.406695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.407019 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.407328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.407659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.407980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.408312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.408609 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.409908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.410295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.410646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.411043 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.411384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.411713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.411985 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.412316 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.412658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.413025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.413364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.413629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.413890 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.414223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.414555 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.415013 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.415479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.415806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.416777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.417110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.417436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.417759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.418081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.418414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.418744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.419087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.419410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.419743 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.420156 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.420416 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.420758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.421115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.421444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.421763 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.422093 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.422424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.422743 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.423061 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.423380 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.423709 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.424053 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.424368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.424626 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.424962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.425281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.425608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.425930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.426248 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.426557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.426862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.427177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.427493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.427811 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.428128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.428441 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.428785 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.429110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.429426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.429739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.430067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.430417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.430736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.431052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.431366 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.431681 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.432009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.432324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.432637 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.433008 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.433324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.433644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.433965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.434281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.434596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.434923 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.435230 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.435546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.435869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.436185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.436497 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.436836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.437149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.437467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.437775 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.438078 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.438395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.438718 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.439035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.439371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.439685 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.440000 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.440312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.440636 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.441023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.441364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.441713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.442035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.442377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.442717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.443045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.443363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.443686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.444020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.444339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.444661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.445002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.445327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.445654 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.445991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.447070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.447399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.447729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.448052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.448407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.448741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.449077 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.449412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.449745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.450113 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.450411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.450744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.451076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.451395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.451714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.452032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.452362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.452713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.453041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.453369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.453690 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.454020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.454328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.454646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.454965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.455313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.455880 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.456463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.456886 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.457163 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.457455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.457774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.458093 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.458405 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.458716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.459032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.459350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.459662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.459992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.460309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.460622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.461061 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.461374 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.462360 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.462679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.463001 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.463316 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.463637 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.463955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.464306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.464593 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.464936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.465251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.465582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.465894 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.466208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.466530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.466850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.467169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.467494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.467828 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.468140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.468460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.468804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.469154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.469493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.469808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.470140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.470468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.470782 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.471091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.471409 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.471721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.472030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.472339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.472655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.472856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 10:42:13.473348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.473495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 10:42:13.473648 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.473648 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.473957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 10:42:13.474110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.474260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 10:42:13.474498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.474655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 10:42:13.474800 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.474953 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.475104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.475257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.475414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.475564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.475714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.475887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.476044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.476187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.476336 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.476480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.476630 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.476817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.476817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.477125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.477412 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.477679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.477845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.477845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.478151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.478151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.478429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-846171-2-iscsi {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.478571 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.478723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.478966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.479116 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.479260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.479419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.479635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.479810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.480044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.480302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.480618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.480798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.480960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.481104 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.481258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.481400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.481560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.481703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.481857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.482006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.482147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.482301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.482454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.482605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.482761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.482903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.483044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.483199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.483342 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.483492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.483644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.483786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.483935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.484095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.484236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.484387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.484627 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.484820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-846171-2-iscsi {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.484973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.485115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.485265 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.485417 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.485560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.485709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.485860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.485860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.486165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.486398 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.486543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.486543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.486833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.486984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.487127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.487127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.487426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.487426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.487902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.488064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.488208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.488375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.488525 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.488702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.488855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.489092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.489256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.489401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.489543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.489776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.489925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.490152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.490327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.490570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.490858 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.491010 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.491162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.491305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.491305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.491598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.491752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.491895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.492044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.492196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.492347 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.492490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.492490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.492911 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.492911 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.493210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.493354 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.493506 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.493663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.493816 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.493971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.494123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.494271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.494419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.494419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.494801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.494964 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.495107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.495257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.495458 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.495603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.495753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.495914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.496067 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.496209 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.496362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.496528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.496671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.496857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.497002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.497151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.497293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.497435 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.497576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.497831 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.498084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.498242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.498386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.498536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.498704 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.47 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.498811 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.498903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.47 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.498976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.499078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.499185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.499357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.499907 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.500002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.500198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.500295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.500528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.500620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.500957 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.501042 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.501208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.501292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.501515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.501605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.501771 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.501854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.502095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.502199 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.502384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.502480 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.502708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.502788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.503020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.503108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.503332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.503432 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.503644 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.503733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.503948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.504037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.504261 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.504355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.504571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.504661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.504912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.505025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.505221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.505324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.505532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.505624 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.505841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.505933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.506153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.506245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.506466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.506557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.506776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.506874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.507100 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.507384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.507476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.507721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.507826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.508033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.508158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.508346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.508462 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.509263 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.509379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.509600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.510090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.510195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.510517 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.510609 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.510700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.510794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.511102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.511216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.511303 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.511395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.511486 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.511578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.511678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.511800 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.511894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.512134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.512332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.512465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.512567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.512762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.512860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.513075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.513164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.513390 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.513489 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.513699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.513790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.514007 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.514106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.514314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.514413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.514616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.514715 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.514956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.515059 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.515228 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.515320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.515536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.515675 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.515845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.515948 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.516148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.516242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.516522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.516621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.516829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.516942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.517142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.517234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.517451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.517548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.517761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.517871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.518134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 10:42:13.518247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.518462 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.518567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.518746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.518851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519712 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.519817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520709 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.520803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.521937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522878 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.522970 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523505 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523595 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.523907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.524160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.525895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526079 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526240 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526393 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.526701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527595 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.527914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.528063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.528230 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.528488 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.528803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.528970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529435 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529593 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.529915 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.530065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.530303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.530458 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.530616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.530887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.531045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.531447 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.531615 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.531776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.531926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.532087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.532246 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.532395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.532571 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.532827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533782 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.533945 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.534095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.534252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.534404 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.535111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.535286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.535449 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.535620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.536196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.536377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.536538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.536728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.536901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537201 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537350 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537525 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.537973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.538127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.538283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.538440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.538608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.538785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.539034 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.539294 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.539458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.539610 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.539785 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.540516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.540671 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.540816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.540929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541828 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.541920 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.542949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.543812 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.544136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.544464 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.544815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545129 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545760 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.545848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546392 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.546824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547155 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547487 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.547978 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.548140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.548293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.548477 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.548605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.549982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.550176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.550327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.550487 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.550714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.550861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.551081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.551225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.551389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.551693 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.551852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.552136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.552282 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.552455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.552710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553085 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553665 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.553803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.554002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.554139 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.554323 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.554553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.554691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.555007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.555160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.555348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.556108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.556276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.556629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.556819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.556980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557131 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557583 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557776 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.557949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.558087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.558380 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.558527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.558691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.558890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.559037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.559345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.559723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.560103 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.560918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.560918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.561345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.561795 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.561967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.562341 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.562479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.562792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.562951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.563349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.563494 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.563642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.563787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.564051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.564239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.564490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.564700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.564857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.565055 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.565209 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.565395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.565648 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.565793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.566090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.566229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.566428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.566594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.566820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.567038 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.567178 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.567402 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.567540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.567728 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.568928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.569069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.569364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.569523 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.569841 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.569999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.570157 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.570296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.570433 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.570737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.570887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.571523 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.571687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.571999 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572299 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572299 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.572741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.573014 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.573163 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.573463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.573846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.573846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.574118 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.574257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.574407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.574553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.574553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.575943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576191 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.576900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577259 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.577889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578209 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.578826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.579052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.579146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.579383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.579483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.579708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580189 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580318 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.580912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.581014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.581216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.581328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.581553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.581665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582310 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582601 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.582912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583654 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583741 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.583826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584046 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.584780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585103 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585636 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.585946 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.586099 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.586240 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.586377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.586544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.586757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.587017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.587339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.587786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588288 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.588992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589649 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589750 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.589967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590055 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590281 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590393 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.590926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591875 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.591968 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.592980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.593162 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.593297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.593477 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.593757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.593900 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594030 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594694 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.594831 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.595002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.595314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596159 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596449 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596828 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.596977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.597984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598538 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598806 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.598935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599588 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599718 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.599992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.600151 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.600453 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.600598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.600844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.600969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601097 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.601749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.602041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.602914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603162 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603274 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603274 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.603988 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604211 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604336 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604704 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.604836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.605752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.606237 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.606380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.606703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.607050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.607384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.607710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.607853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.608029 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.608138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.608355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.608450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.608827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.609148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.609497 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.609961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610077 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610283 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610809 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.610911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611136 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611244 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.611901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612244 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612402 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.612904 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.613047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.613229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.613359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.613591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.613975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614077 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614613 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.614947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615054 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615896 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.615995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.616328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.616635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.616909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.617004 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.617293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.617535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.617640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.617935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.618702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.618864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.619330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.619434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.619659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.619932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.620025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.620264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.620536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.620788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.620903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.621256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.621441 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.621792 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.622013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.622112 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.622633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.623039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.623663 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.624015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.624354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.624709 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.625029 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.625359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.625463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.625687 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.625780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626649 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.626990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.627225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.627326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.627611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.627820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.627914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.628240 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.628439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.628556 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.628847 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.628936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.629926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.630306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.630475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.630640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.630803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.630960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631446 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631602 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631765 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.631922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632625 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.632986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.633991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.634094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.634410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.634502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.634733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.634821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.635057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.635153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.635545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.635671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.635910 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.636009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.636297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.636622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.636750 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637738 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.637902 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.638868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639021 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639684 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.639854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.640025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.640178 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.640330 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.640501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.640671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.641994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642118 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642209 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.642949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.643190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.643294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.643571 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.643755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.643922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.644252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.644364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.644578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.644709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.644930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645668 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.645992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.646207 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.646313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.646524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.646616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.646847 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.647068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.647167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.647489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.647587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.647799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.648073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.648231 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.648554 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.648658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.649326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.649980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.650476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.651054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.651383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.651699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.652141 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.652570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.653074 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.653186 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.653438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.653568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.653791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.654991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.655193 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.655296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.655528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.655700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.655877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.656229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.656331 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.656554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.656666 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.656900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657366 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.657896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.658853 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659599 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659753 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.659900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660040 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660572 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.660896 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661367 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661666 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.661898 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662046 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662199 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662518 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.662942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663231 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663372 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663600 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663765 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.663909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.664056 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.664206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.664348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.664499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.664640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.665352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.665575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.665793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.665941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.666150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.666646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.666839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.666989 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.667430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.667817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.668154 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.668434 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.668576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.668980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.669539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.669953 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.670352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.670483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.670709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.670850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.671191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.671285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.671747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.672306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.672503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.672791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.672933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.673237 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.673370 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.673567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.673759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.673925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674349 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.674911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675337 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.675880 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.676025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.676227 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.676565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.676976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677484 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677643 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.677970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678484 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.678959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679601 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.679928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.680151 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.680251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.680573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.681300 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.681482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.681652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.681798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.681987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.682120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.682344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.682500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.682670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.682772 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683119 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683342 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.683897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.684131 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.684301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.684521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.684618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.684954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685390 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685602 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.685907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.686868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.687003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.687126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124844) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:42:13.687275 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.687490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.687809 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.688122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.688436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.688790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.689104 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.689435 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.689753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.690067 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.690378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.690692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.691045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.691356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.691701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.692023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.692348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.692699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.693025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.693357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.693681 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.694008 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.694329 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.694652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.694975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.695298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.695619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.695938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.696317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.696638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.696997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.697573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.697913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.698237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.698559 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.698880 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.699201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.699525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.699844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.700164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.700483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.700827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.701167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.701497 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.701829 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.702174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.702501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.702822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.703143 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.703462 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.703832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.704158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.704468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.704812 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.706933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.707252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.707576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.707892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.708213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.708553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.708924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.709254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.709575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.709893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.710217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.710803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.711127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.711468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.712331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.712660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.713018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.713337 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.713696 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.713982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.714295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.714610 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.714925 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.715233 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.715562 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.715878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.716221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.716512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.716854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.717456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.717814 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.718139 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.718474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.718803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.719126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.719438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.719769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.720081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.720392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.720736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.721057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.721367 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.721675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.721994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.722310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.723133 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.723133 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.723318 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.723550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.723860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.724168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.724480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.724821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.725134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.725443 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.725755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.726064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.726387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.726694 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.727011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.728040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.729359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.729359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.729359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.729649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.729783 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.730097 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.730408 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.730737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.731056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.731384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.731705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.732025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.732384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.732728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.733330 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.733671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.733997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.734341 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.734681 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.734991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.735301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.735610 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.735939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.736254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.736572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.736926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.737244 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.737563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.737877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.738191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.739025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.739025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.739231 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.739410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.739723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.740036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.740358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.740739 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.741071 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.741393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.741714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.742034 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.742346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.742659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.742974 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.743285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.743604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.743941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.744258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.744568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.745051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.745369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.745693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.746017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.746333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.746675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.746977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.747299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.747626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.747940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.748272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.748618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.749000 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.749330 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.749641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.749950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.750259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.750572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.750896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.751210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.751516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.751824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.752139 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.752448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.752781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.753092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.753399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.753711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.754014 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.754321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.754627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.754964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.755236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.755539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.755850 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.756156 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.756464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.756831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.757106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.757411 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.757755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.758089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.758406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.758889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.759033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.759355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.759667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.759989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.760312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.760633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.760974 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.761723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.761723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.761927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.762227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.762538 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.762852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.763170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.763536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.763867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.764177 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.764506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.764892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.765226 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.765544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.765861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.766191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.766507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.766895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.767142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.767461 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.767775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.768094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.768409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.768743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.769065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.769386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.769722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.770512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.770512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.770713 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.770993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.771351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.771668 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.772020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.772351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.772670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.773022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.773331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 10:42:13.773578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124843) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 10:42:13.838966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Registered counter for database nova_api Jul 18 10:42:13.860100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:13.867134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:13.924506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Registered counter for database nova_api Jul 18 10:42:13.925195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.context [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a78ea71-f9a3-4be8-8869-eba1a93328a9(cell1) {{(pid=124844) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:42:13.929145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:42:13.931324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:42:13.932143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:42:13.934133 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:42:13.936109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Registered counter for database nova_cell0 Jul 18 10:42:13.940140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Registered counter for database nova_cell1 Jul 18 10:42:13.945109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:13.948026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:13.950527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:13.952500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:13.955565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:13.958620 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:14.010566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.context [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a78ea71-f9a3-4be8-8869-eba1a93328a9(cell1) {{(pid=124843) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 10:42:14.014550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:42:14.016109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:42:14.016997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:42:14.018903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:42:14.020912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Registered counter for database nova_cell0 Jul 18 10:42:14.024996 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Registered counter for database nova_cell1 Jul 18 10:42:14.033710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:14.034710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:14.042776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:14.043121 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:14.113345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO dbcounter [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Registered counter for database nova_cell0 Jul 18 10:42:14.121019 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_db.sqlalchemy.engines [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124844) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:14.125642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writer thread running {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:14.194601 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO dbcounter [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Registered counter for database nova_cell0 Jul 18 10:42:14.203314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_db.sqlalchemy.engines [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124843) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 10:42:14.208174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writer thread running {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 10:42:14.442285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:42:14.449951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:42:14.532411 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:42:14.540362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:42:14.795398 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:42:14.801673 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: WARNING keystonemiddleware.auth_token [None req-12a17fd3-7ebb-426d-b8d4-3a349cf3d2ca None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:42:14.807799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56047b0229c0 pid: 124844 (default app) Jul 18 10:42:14.885997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 10:42:14.891964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: WARNING keystonemiddleware.auth_token [None req-5dbe9746-5d8e-4423-a771-07a6af3e8358 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 10:42:14.897275 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56047b0229c0 pid: 124843 (default app) Jul 18 10:42:56.133739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:56.135640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:56.136581 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:56.137881 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.223707 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.233755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.233755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.233755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:42:57.322926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-da10526c-f301-45d6-b14c-e907faa21bd2 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Action: 'create', calling method: .version_select at 0x7f5f0c65b8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-86913234", "metadata": {"Type": "work"}}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:42:58.076947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-10202ffa-3fc3-401a-b775-1232496661ac tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Action: 'create', calling method: .version_select at 0x7f5f0c65e8b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1758323132", "metadata": {"Type": "work"}}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-10202ffa-3fc3-401a-b775-1232496661ac tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 122 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.101978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1758323132", "metadata": {"Type": "work"}}} Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.103762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1758323132', 'metadata': {'Type': 'work'}}}} Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.108934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:42:58.110721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:42:58.112089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 10:42:58.112089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.112089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-10202ffa-3fc3-401a-b775-1232496661ac tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.112089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-10202ffa-3fc3-401a-b775-1232496661ac tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.918123 Jul 18 10:42:58.112089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 1/1] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Jul 18 10:42:57 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 920 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:42:58.114899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd1efc08-eb2e-427a-9690-8c1387293161 tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Action: 'create', calling method: .version_select at 0x7f5f0c66cb80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2107629998", "metadata": {"Type": "work"}}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd1efc08-eb2e-427a-9690-8c1387293161 tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 120 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.117691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2107629998", "metadata": {"Type": "work"}}} Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.119210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2107629998', 'metadata': {'Type': 'work'}}}} Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi '0' Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.126826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:42:58.128392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:42:58.129749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 10:42:58.129749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.129749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd1efc08-eb2e-427a-9690-8c1387293161 tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.129749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cd1efc08-eb2e-427a-9690-8c1387293161 tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009092 Jul 18 10:42:58.129749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 2/2] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Jul 18 10:42:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:42:58.133763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc290a85-399f-454d-b0d3-22fa7990ebec tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Action: 'create', calling method: .version_select at 0x7f5f0c65ec10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1858259117", "metadata": {"Type": "work"}}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc290a85-399f-454d-b0d3-22fa7990ebec tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 119 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.136256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1858259117", "metadata": {"Type": "work"}}} Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.137551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1858259117', 'metadata': {'Type': 'work'}}}} Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise error Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi '' Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.138304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 10:42:58.140153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 10:42:58.141297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 10:42:58.141297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.141297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc290a85-399f-454d-b0d3-22fa7990ebec tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.141297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc290a85-399f-454d-b0d3-22fa7990ebec tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011595 Jul 18 10:42:58.141297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 3/3] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Jul 18 10:42:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:42:58.150909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-742609ed-bcb3-41ab-95e7-3bb7d64ad3ca tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Calling method '.version_select at 0x7f5f0c589820>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:42:58.364755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-742609ed-bcb3-41ab-95e7-3bb7d64ad3ca tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] HTTP exception thrown: Volume tempest-invalid-875664431 could not be found. Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-742609ed-bcb3-41ab-95e7-3bb7d64ad3ca tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-875664431 HTTP/1.1 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.369148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume tempest-invalid-875664431 could not be found. Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'tempest-invalid-875664431'} Jul 18 10:42:58.370452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-875664431 could not be found. (HTTP 404) (Request-ID: req-9179682e-3c5d-4961-9ea2-b528815aeff0) Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.371189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:42:58.372299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-875664431 could not be found. Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:42:58.375951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-875664431 could not be found. Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-875664431 could not be found. Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-742609ed-bcb3-41ab-95e7-3bb7d64ad3ca tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 404 to user: Volume tempest-invalid-875664431 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-742609ed-bcb3-41ab-95e7-3bb7d64ad3ca tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/tempest-invalid-875664431" status: 404 len: 98 microversion: 2.1 time: 0.224908 Jul 18 10:42:58.379264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 4/4] 10.222.0.47 () {58 vars in 1214 bytes} [Mon Jul 18 10:42:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-875664431 => generated 98 bytes in 226 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 18 10:42:58.383061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2698642f-87f8-4046-976f-d4d83c4e04ee tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003945 Jul 18 10:42:58.385881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 5/5] 10.222.0.47 () {58 vars in 1139 bytes} [Mon Jul 18 10:42:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 10:42:58.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ac1792c8-b2eb-4869-95fa-ad8bb5d51e86 tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005072 Jul 18 10:42:58.400251 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 6/6] 10.222.0.47 () {58 vars in 1136 bytes} [Mon Jul 18 10:42:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 10:42:58.409083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da37f591-e197-46df-85a3-6210f518dd6f tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Calling method '.version_select at 0x7f5f0c4b9c10>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:42:58.441362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-da37f591-e197-46df-85a3-6210f518dd6f tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] HTTP exception thrown: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da37f591-e197-46df-85a3-6210f518dd6f tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/os-volumes/4927633c-b487-46e5-b791-68c41b0f52f7 HTTP/1.1 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.443906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '4927633c-b487-46e5-b791-68c41b0f52f7'} Jul 18 10:42:58.448800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. (HTTP 404) (Request-ID: req-34626c68-2264-4cc9-88dd-5513ff779b59) Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.449740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:42:58.450894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:42:58.451962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da37f591-e197-46df-85a3-6210f518dd6f tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 404 to user: Volume 4927633c-b487-46e5-b791-68c41b0f52f7 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-da37f591-e197-46df-85a3-6210f518dd6f tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/4927633c-b487-46e5-b791-68c41b0f52f7" status: 404 len: 109 microversion: 2.1 time: 0.041308 Jul 18 10:42:58.453351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 7/7] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:42:58 2022] DELETE /compute/v2.1/os-volumes/4927633c-b487-46e5-b791-68c41b0f52f7 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:42:58.459242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec8376ef-d7dd-4d13-ba7d-45976145057c tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Calling method '.version_select at 0x7f5f0c4b9790>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:42:58.489770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-ec8376ef-d7dd-4d13-ba7d-45976145057c tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] HTTP exception thrown: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec8376ef-d7dd-4d13-ba7d-45976145057c tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Request method failure captured: Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-volumes/4873f801-35c4-4232-98ec-64b2a1fc604d HTTP/1.1 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkxiwV4UnHRbfIGiG-ClxtrkCzG0FEzhyjlrZoKc_qX6r1Tdzp9PhqKR5dj1X_9K3UvXl0YTWisw1oJFpwPa3BdUds5Cw2y0HDvTNY5XnD4ZyUb9N21CU57aEoVZt-AnTfz0c3Y2nc74l70pgkITfgYwXzR7hIWHCG78kfuFsPeFcw Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:42:58.492506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/0ff7695de0d44e55a0f1b7396c3fd0e7"}]}] Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 0ff7695de0d44e55a0f1b7396c3fd0e7 Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesNegativeTest-882673834 Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 74d7e32d47864c9a8294d8c4dd954618 Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesNegativeTest-882673834-project Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '4873f801-35c4-4232-98ec-64b2a1fc604d'} Jul 18 10:42:58.494216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. (HTTP 404) (Request-ID: req-f97fad78-4687-4740-aea9-a8cc2493a888) Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.495009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:42:58.496197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:42:58.497323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec8376ef-d7dd-4d13-ba7d-45976145057c tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] Returning 404 to user: Volume 4873f801-35c4-4232-98ec-64b2a1fc604d could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:42:58.498398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec8376ef-d7dd-4d13-ba7d-45976145057c tempest-VolumesNegativeTest-882673834 tempest-VolumesNegativeTest-882673834-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/4873f801-35c4-4232-98ec-64b2a1fc604d" status: 404 len: 109 microversion: 2.1 time: 0.039443 Jul 18 10:42:58.515924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 8/8] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:42:58 2022] GET /compute/v2.1/os-volumes/4873f801-35c4-4232-98ec-64b2a1fc604d => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:42:59.140469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-da10526c-f301-45d6-b14c-e907faa21bd2 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 2.692793 Jul 18 10:42:59.140469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 1/9] 10.222.0.47 () {60 vars in 1155 bytes} [Mon Jul 18 10:42:56 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 2695 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 18 10:42:59.144065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d51b270-ddf5-4d1e-bc00-909d0a830d00 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c4b9af0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:42:59.144065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1d51b270-ddf5-4d1e-bc00-909d0a830d00 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 200 len: 351 microversion: 2.1 time: 0.089762 Jul 18 10:42:59.144065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 9/10] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:42:58 2022] GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 351 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:42:59.814183 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-85e8693f-aea8-48a3-af1f-96d56ced7b76 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c525700>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:42:59.877802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-85e8693f-aea8-48a3-af1f-96d56ced7b76 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/71f56724-3d29-474a-865e-4fc36b9556f0" status: 200 len: 351 microversion: 2.1 time: 0.068876 Jul 18 10:42:59.878991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 2/11] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:42:59 2022] GET /compute/v2.1/os-volumes/71f56724-3d29-474a-865e-4fc36b9556f0 => generated 351 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:42:59.925720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fe10fdf6-c6e1-4fe1-96f8-ea33c9e99e1e tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c4c23a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:00.032788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fe10fdf6-c6e1-4fe1-96f8-ea33c9e99e1e tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 200 len: 352 microversion: 2.1 time: 0.111862 Jul 18 10:43:00.033990 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 10/12] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:42:59 2022] GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:00.046243 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a820a21a-29e6-41cd-b1d0-efd2c017f65e tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c525820>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:00.139897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a820a21a-29e6-41cd-b1d0-efd2c017f65e tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 200 len: 352 microversion: 2.1 time: 0.091669 Jul 18 10:43:00.139897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 3/13] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:43:00 2022] GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 352 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:00.156923 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-368c78d6-7744-4545-bc99-7d9fc4f8ee8a tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c4c2ca0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:00.505793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-368c78d6-7744-4545-bc99-7d9fc4f8ee8a tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 202 len: 0 microversion: 2.1 time: 0.353833 Jul 18 10:43:00.506378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 11/14] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:43:00 2022] DELETE /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:43:00.514623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c5e04232-6445-4b48-9486-5d6a7625dc78 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c525ee0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:00.590478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c5e04232-6445-4b48-9486-5d6a7625dc78 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 200 len: 351 microversion: 2.1 time: 0.079623 Jul 18 10:43:00.591035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 4/15] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:43:00 2022] GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:01.604045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd3f5c9e-7b48-40c7-8216-a770683e2b71 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Calling method '.version_select at 0x7f5f0c4573a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:01.654537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-cd3f5c9e-7b48-40c7-8216-a770683e2b71 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] HTTP exception thrown: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd3f5c9e-7b48-40c7-8216-a770683e2b71 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Request method failure captured: Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 HTTP/1.1 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TkwLuD2Cyo28ldDPbZHZsyIrcRZlo8rM80GLp24Xt6mPggKzIw3shZ2K1naFb74TjAtKgSi5HQ-9S9dmdVvAMC5SnTbo0YoEV3RVyFBsNmfsHLA4dvxIHwtgvRFbK26QDqnO_3XCzdzaFK1Cd63eIiqraoyvG__xEntDt30Zrx7FZc Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: b9c9dd4556f443508b4d63a0001b0111 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesGetTestJSON-979201364 Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:43:01.656638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b9c9dd4556f443508b4d63a0001b0111"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b9c9dd4556f443508b4d63a0001b0111"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b9c9dd4556f443508b4d63a0001b0111"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b9c9dd4556f443508b4d63a0001b0111"}]}] Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesGetTestJSON-979201364 Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: b9c9dd4556f443508b4d63a0001b0111 Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesGetTestJSON-979201364 Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesGetTestJSON-979201364-project Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 21ea6a5a7cd347229a1755f68cc70f73 Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesGetTestJSON-979201364-project Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'dba184e7-280a-4073-88b0-04428e8a18d2'} Jul 18 10:43:01.657819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. (HTTP 404) (Request-ID: req-bd8556e2-afb9-4404-abdd-260bb817b040) Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:43:01.658413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:43:01.659242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:43:01.660091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. Jul 18 10:43:01.660924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:43:01.662682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cd3f5c9e-7b48-40c7-8216-a770683e2b71 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] Returning 404 to user: Volume dba184e7-280a-4073-88b0-04428e8a18d2 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:43:01.663991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cd3f5c9e-7b48-40c7-8216-a770683e2b71 tempest-VolumesGetTestJSON-979201364 tempest-VolumesGetTestJSON-979201364-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2" status: 404 len: 109 microversion: 2.1 time: 0.063588 Jul 18 10:43:01.663991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 12/16] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:43:01 2022] GET /compute/v2.1/os-volumes/dba184e7-280a-4073-88b0-04428e8a18d2 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:43:01.852933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-25ad432f-f2da-4a08-8440-9d69c8473cbd tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c53b5e0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:01.988790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-25ad432f-f2da-4a08-8440-9d69c8473cbd tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/8308c0bb-88c2-460e-a080-8e6b06b14cc6" status: 200 len: 351 microversion: 2.1 time: 0.142909 Jul 18 10:43:01.989973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 5/17] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:43:01 2022] GET /compute/v2.1/os-volumes/8308c0bb-88c2-460e-a080-8e6b06b14cc6 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:04.580193 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2c2970e5-49e1-4ab7-8601-47d9f3d33981 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c4c2280>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:04.720582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2c2970e5-49e1-4ab7-8601-47d9f3d33981 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/9532eb94-d964-4ef4-a9b9-34431fdf2fd9" status: 200 len: 351 microversion: 2.1 time: 0.142979 Jul 18 10:43:04.720582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 13/18] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:43:04 2022] GET /compute/v2.1/os-volumes/9532eb94-d964-4ef4-a9b9-34431fdf2fd9 => generated 351 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:04.734576 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d339b601-629c-4b49-b144-417923b96bd8 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c525dc0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:05.052160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d339b601-629c-4b49-b144-417923b96bd8 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.322938 Jul 18 10:43:05.052749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 6/19] 10.222.0.47 () {58 vars in 1133 bytes} [Mon Jul 18 10:43:04 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:05.067870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e506d0ea-3756-45d5-aa3e-5c84e9dc8f14 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c4b94c0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:05.357177 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e506d0ea-3756-45d5-aa3e-5c84e9dc8f14 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.295163 Jul 18 10:43:05.357959 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 14/20] 10.222.0.47 () {58 vars in 1148 bytes} [Mon Jul 18 10:43:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:05.373445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2b894a40-d1e2-4ca7-89bb-e51fa79b0839 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c53b670>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:05.560090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2b894a40-d1e2-4ca7-89bb-e51fa79b0839 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.190710 Jul 18 10:43:05.560655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 7/21] 10.222.0.47 () {58 vars in 1133 bytes} [Mon Jul 18 10:43:05 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:05.572332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1bc4e56f-d330-400d-8b2d-de6d892fec3e tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c4b9e50>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:05.753009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1bc4e56f-d330-400d-8b2d-de6d892fec3e tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.184193 Jul 18 10:43:05.753619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 15/22] 10.222.0.47 () {58 vars in 1166 bytes} [Mon Jul 18 10:43:05 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:05.770596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-717f5089-52dd-4273-ba92-8fb4aa2e3a29 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c5421f0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:06.013820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-717f5089-52dd-4273-ba92-8fb4aa2e3a29 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.248824 Jul 18 10:43:06.014852 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 8/23] 10.222.0.47 () {58 vars in 1169 bytes} [Mon Jul 18 10:43:05 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:06.028929 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-16f3225d-bddf-4352-a7e6-266cf147b199 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c4c2670>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:06.360056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-16f3225d-bddf-4352-a7e6-266cf147b199 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.334968 Jul 18 10:43:06.361158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 16/24] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Jul 18 10:43:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:06.378436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c9b9f011-a2c6-456f-9292-9e5cd9b13845 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0c53bc10>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:06.599669 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c9b9f011-a2c6-456f-9292-9e5cd9b13845 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.228268 Jul 18 10:43:06.601432 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 9/25] 10.222.0.47 () {58 vars in 1187 bytes} [Mon Jul 18 10:43:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:06.615175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f4ab54ad-92d4-4040-a681-abf3f4043584 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] Calling method '.version_select at 0x7f5f0cd84160>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:06.917134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f4ab54ad-92d4-4040-a681-abf3f4043584 tempest-VolumesTestJSON-2063092164 tempest-VolumesTestJSON-2063092164-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.306215 Jul 18 10:43:06.917759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 17/26] 10.222.0.47 () {58 vars in 1154 bytes} [Mon Jul 18 10:43:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:10.838012 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-153104335", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:11.110114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] validate_networks() for [('4c142228-b6cb-455d-9edf-375af8a017d1', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:13.513600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:13.514837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:13.515628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:13.516186 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:13.516905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:13.533971 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:13.535885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:13.535885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:13.536058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:13.620551 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:13.639417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for user b86d6011a3f04ad0bf5b8be696c789f2 and project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:13.679943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:13.690580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:13.981383 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dcc04dd0-1108-4e0c-8ea7-8c953501b5b6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.633303 Jul 18 10:43:13.987700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 10/27] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:43:13.994926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-432be583-541a-46b2-a70c-5c8e4548a1d0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:13.995671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-432be583-541a-46b2-a70c-5c8e4548a1d0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:14.249724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-432be583-541a-46b2-a70c-5c8e4548a1d0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:14.292003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-432be583-541a-46b2-a70c-5c8e4548a1d0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1221 microversion: 2.1 time: 0.302807 Jul 18 10:43:14.295460 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 18/28] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:13 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1221 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:15.258780 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-154474692", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:15.353435 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] validate_networks() for [('4c142228-b6cb-455d-9edf-375af8a017d1', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:17.639803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:17.641074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:17.641563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:17.641984 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:17.645446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:17.676217 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:17.676672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:17.678037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:17.686263 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:17.793318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:17.804983 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for user b86d6011a3f04ad0bf5b8be696c789f2 and project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:17.845290 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:17.851319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:18.039902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-852d9094-6f23-422b-a781-a82244e443c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.785741 Jul 18 10:43:18.040848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 11/29] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 2788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:43:18.051301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bf983e98-ed75-48d1-b400-bc3f929c6dff tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:18.051833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bf983e98-ed75-48d1-b400-bc3f929c6dff tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:18.172908 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bf983e98-ed75-48d1-b400-bc3f929c6dff tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:18.194064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bf983e98-ed75-48d1-b400-bc3f929c6dff tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1221 microversion: 2.1 time: 0.137613 Jul 18 10:43:18.194064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 19/30] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:18 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:19.683942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8dcd4bbc-1b6d-428b-8535-3b4cf85bff7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: .version_select at 0x7f5f0c44a3a0>, body: {"keypair": {"name": "tempest-keypair-948545523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFYZ9H5PceNxni4roRufyzJrMTxMH8kfa5YhYdpQdL0RPvRGdFwYyEL86NCdFBmvdt9baoLACJ6OeMQhecULrokLnjPZoxpN32+2XEkV7Y0BbhlKFSKcN6lnLg3dhdHGA=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:19.740591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-8dcd4bbc-1b6d-428b-8535-3b4cf85bff7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:19.746755 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-8dcd4bbc-1b6d-428b-8535-3b4cf85bff7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:19.760997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7cc37527-0f78-4d56-ad33-a558b144c990 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: .version_select at 0x7f5f0c4809d0>, body: {"keypair": {"name": "tempest-keypair-987356706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHqSNIgGXEaf6wJQa8ih35RX4y8+h1bhod1ThVwa536oghjQkWAmROZcWhRKqsC749y0P8QMNDRUAHKjNHpQ8v7uB/5Wh37kpbSGTwvKRG9/Gu8PVzm1w7IXSG98tTr1UA=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:19.875255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-7cc37527-0f78-4d56-ad33-a558b144c990 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:19.900879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-7cc37527-0f78-4d56-ad33-a558b144c990 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for user df7a3101955b481f9a582168731ae76c and project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:19.973420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8dcd4bbc-1b6d-428b-8535-3b4cf85bff7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.116148 Jul 18 10:43:19.974206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 12/31] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:43:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:19.979532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-30bf0dc9-6f75-488a-ad51-cc323aa00189 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:19.980304 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-30bf0dc9-6f75-488a-ad51-cc323aa00189 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:20.087878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7cc37527-0f78-4d56-ad33-a558b144c990 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.153126 Jul 18 10:43:20.089025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 20/32] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Jul 18 10:43:18 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:43:20.257151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-30bf0dc9-6f75-488a-ad51-cc323aa00189 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:20.297234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-30bf0dc9-6f75-488a-ad51-cc323aa00189 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1221 microversion: 2.1 time: 0.318885 Jul 18 10:43:20.297234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 13/33] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:19 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1221 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:20.399440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1645250083", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "networks": [{"uuid": "bad3a61c-7fc2-42b7-9e8c-9332a84a613e"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:20.625334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] validate_networks() for [('bad3a61c-7fc2-42b7-9e8c-9332a84a613e', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:21.312701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:21.313616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:21.333234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:21.333804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:21.334631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:21.335085 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:22.151120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:22.179399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2f424243-c951-493a-8628-0ab6db4f18de tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1273 microversion: 2.1 time: 0.870440 Jul 18 10:43:22.181037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 14/34] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:21 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1273 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:22.520518 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-04782341-79d8-4586-a4ae-a133d6d7e0ca tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: .version_select at 0x7f5f0ab3f1f0>, body: {"keypair": {"name": "tempest-keypair-933571270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDFy5B6q1CBCqWRCcqcYD0uZcgXuxucALWKmIdpLjutQ7A3BB6gkE451xL7lmoG1WLrvWH1o1R5L0EzaXItN2IqOKU/o1PeW15iZuO+kVU2eShfF9rfZtywb8Vra6boG8A=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:22.559119 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-04782341-79d8-4586-a4ae-a133d6d7e0ca tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for project 9e4aa903be8d4afc91f368051333848b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:22.569527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-04782341-79d8-4586-a4ae-a133d6d7e0ca tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for user 17e0c6def385441bbdde18c63b7d99e3 and project 9e4aa903be8d4afc91f368051333848b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:22.687542 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-04782341-79d8-4586-a4ae-a133d6d7e0ca tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.505236 Jul 18 10:43:22.688658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 15/35] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:43:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:23.199215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:23.199846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:23.230411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:23.241584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:23.241584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:23.241584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:23.710994 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:23.720580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9c805556-9f7f-464d-82e5-f77175e74a02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1279 microversion: 2.1 time: 0.526243 Jul 18 10:43:23.726051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 16/36] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:23 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1279 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:24.014096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:24.015594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:24.016337 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:24.016978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:24.017587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:24.042309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:24.045266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:24.047173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:24.049151 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:24.140416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Getting quotas for project f5f3aeaf69e147fc9c2e04723cea0fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:24.168398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Getting quotas for user 8eb0ed48dd034be0ad63373e4a151cd9 and project f5f3aeaf69e147fc9c2e04723cea0fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:24.195533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:24.199969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:24.488435 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eaf8c838-81f6-4889-ad5f-3fdb90ac54e4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.398150 Jul 18 10:43:24.489130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 21/37] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:43:24.501168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-70c7e55d-0e71-44fe-92ca-2322ea2e84ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:24.502115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-70c7e55d-0e71-44fe-92ca-2322ea2e84ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:24.746793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:24.747435 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:24.780877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:24.790507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:24.794287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:24.800729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:25.355623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-70c7e55d-0e71-44fe-92ca-2322ea2e84ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:25.355623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-70c7e55d-0e71-44fe-92ca-2322ea2e84ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1215 microversion: 2.1 time: 0.841225 Jul 18 10:43:25.355623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 17/38] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:24 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1215 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:26.112813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:26.147076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c36c3b70-fc0d-47fd-ac4d-0fc0f39df1c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1279 microversion: 2.1 time: 1.403725 Jul 18 10:43:26.150912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 22/39] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:24 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1279 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:26.371702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-85021f23-05fe-449d-9988-19b5c4ed23ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:26.373228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-85021f23-05fe-449d-9988-19b5c4ed23ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:26.771414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-85021f23-05fe-449d-9988-19b5c4ed23ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:26.780973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-85021f23-05fe-449d-9988-19b5c4ed23ae tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1215 microversion: 2.1 time: 0.412738 Jul 18 10:43:26.794777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 18/40] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:26 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1215 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:27.172825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:27.174870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:27.216865 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:27.220300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:27.237439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:27.246262 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:27.802137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:27.803475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:27.816374 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:27.845673 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:27.847327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:27.855785 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:27.857410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:28.125297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:28.136146 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-48e7efb0-773b-4cc8-993c-837f1b814ee3 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1211 microversion: 2.1 time: 0.337816 Jul 18 10:43:28.137801 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 19/41] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:27 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1211 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:28.151722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:28.169614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fe0c8e35-59d9-46a8-8999-f59040d15498 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 1.005897 Jul 18 10:43:28.171961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 23/42] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:27 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:29.155477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:29.158279 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:29.182838 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:29.183742 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:29.188040 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:29.189684 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:29.198982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:29.200195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:29.237567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:29.239448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:29.242133 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:29.242786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:29.783155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:29.792553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-73d68248-fe54-4d22-8b5a-fe1a7e4069c1 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1275 microversion: 2.1 time: 0.642224 Jul 18 10:43:29.815258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 20/43] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:29 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1275 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:30.210851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:30.224522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-925d1c97-ed5d-49da-a00d-2f12d6ac5215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 1.037066 Jul 18 10:43:30.226544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 24/44] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:29 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:30.818226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:30.818872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:30.825319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:30.825773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:30.826562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:30.827010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.213064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:31.221821 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5a04262-2122-4f6b-881d-110d97afb1b0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1273 microversion: 2.1 time: 0.406483 Jul 18 10:43:31.241540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:31.242190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:31.247328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 21/45] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:30 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1273 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:31.249525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:31.249944 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.250740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:31.251184 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.687107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-f355abaf-8ca8-4ca6-9bed-c08c2ffcaced req-bfd88d6d-466e-453c-bdff-3f9cfc4b8389 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "177dc191-0770-4ba1-9219-e38d05c4091d", "tag": "fc4600b0-7d19-4e9b-9742-053a0a1747fd"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:31.720430 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f355abaf-8ca8-4ca6-9bed-c08c2ffcaced req-bfd88d6d-466e-453c-bdff-3f9cfc4b8389 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:31.721070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f355abaf-8ca8-4ca6-9bed-c08c2ffcaced req-bfd88d6d-466e-453c-bdff-3f9cfc4b8389 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.767302 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-f355abaf-8ca8-4ca6-9bed-c08c2ffcaced req-bfd88d6d-466e-453c-bdff-3f9cfc4b8389 service nova] Creating event network-changed:fc4600b0-7d19-4e9b-9742-053a0a1747fd for instance 177dc191-0770-4ba1-9219-e38d05c4091d on hv-cinder-84617 Jul 18 10:43:31.771373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f355abaf-8ca8-4ca6-9bed-c08c2ffcaced req-bfd88d6d-466e-453c-bdff-3f9cfc4b8389 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:43:31.776383 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:31.777350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.778498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:31.779188 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:31.790563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.compute.rpcapi [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:43:31.791808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] Releasing lock "compute-rpcapi-router" {{(pid=124844) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:43:31.828563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4bad7abb-3600-4cc3-a59d-38a3ee36496c None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.274859 Jul 18 10:43:31.829797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 22/46] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:32.244786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:32.245584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:32.282882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:32.283356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:32.284151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:32.284718 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:32.823421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:32.837121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5b2d7db0-929b-4e24-9094-e4c55e4f9370 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1273 microversion: 2.1 time: 0.599500 Jul 18 10:43:32.837757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 23/47] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:32 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1273 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:33.348831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:33.358317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-262b864f-ee02-4363-a648-4cb82eedef0a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 2.120706 Jul 18 10:43:33.375182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 25/48] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:31 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 2138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:33.866177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:33.868255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:33.914683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:33.916575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:33.918622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:33.938332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:34.345586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-561326340", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2dbda6c-55b0-4f7b-9d2c-cba5f0c84c63"}], "security_groups": [{"name": "tempest-securitygroup--997192181"}], "key_name": "tempest-keypair-933571270", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:34.368035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:34.368906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=14 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:34.747279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] validate_networks() for [('d2dbda6c-55b0-4f7b-9d2c-cba5f0c84c63', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:34.772164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:34.793762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-76552db9-060e-44fe-a016-1437c9715c22 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.942215 Jul 18 10:43:34.803447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 24/49] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:33 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:34.821563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:34.822561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:34.837531 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:34.838348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:34.839619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:34.840255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:35.325710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:35.338527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b1f3f8d7-2d54-4aaa-915e-f719669369fa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.533505 Jul 18 10:43:35.343540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 25/50] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:34 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:35.501534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-165c4a67-8fc3-46f5-9a9e-bec54a42637f req-2dbb983d-d83c-4d82-9225-816266fd129b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a77460bc-275e-4141-8386-f5ac57bddac1", "tag": "535ac1fb-1cfa-4d73-b6f3-c11a89d00401"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:35.530921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-165c4a67-8fc3-46f5-9a9e-bec54a42637f req-2dbb983d-d83c-4d82-9225-816266fd129b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:35.531517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-165c4a67-8fc3-46f5-9a9e-bec54a42637f req-2dbb983d-d83c-4d82-9225-816266fd129b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:35.568458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-165c4a67-8fc3-46f5-9a9e-bec54a42637f req-2dbb983d-d83c-4d82-9225-816266fd129b service nova] Creating event network-changed:535ac1fb-1cfa-4d73-b6f3-c11a89d00401 for instance a77460bc-275e-4141-8386-f5ac57bddac1 on hv-cinder-84617 Jul 18 10:43:35.577537 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-165c4a67-8fc3-46f5-9a9e-bec54a42637f req-2dbb983d-d83c-4d82-9225-816266fd129b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231963 Jul 18 10:43:35.585818 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 26/51] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:35.822745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:35.824096 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:35.841266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:35.846995 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:35.849819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:35.851035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:36.631791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:36.646334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=63 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:36.650790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dea29a41-88bc-4b4e-83ed-5e7c19416a8c tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.834934 Jul 18 10:43:36.656956 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 27/52] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:35 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:36.681809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2102694529", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e30748c-0952-4f2b-8af8-e6ac162a4aec"}], "security_groups": [{"name": "tempest-securitygroup--1662558759"}], "key_name": "tempest-keypair-987356706", "user_data": "}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:36.710957 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:36.776297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=26 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:36.897382 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:36.897900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:36.898373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:36.898796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:36.899266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:36.919818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:36.920325 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:36.928963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:36.929492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:36.939296 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] validate_networks() for [('1e30748c-0952-4f2b-8af8-e6ac162a4aec', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:36.997693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for project 9e4aa903be8d4afc91f368051333848b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:37.008221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for user 17e0c6def385441bbdde18c63b7d99e3 and project 9e4aa903be8d4afc91f368051333848b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:37.054770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:37.057097 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:37.246729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-130b4c75-f637-47c7-8332-c8d42977a03d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.905748 Jul 18 10:43:37.267111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 26/53] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:43:37.267348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1448966941", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c67416e9-65e7-4c80-a421-5c4140e97b67"}], "security_groups": [{"name": "tempest-securitygroup--1930555607"}], "key_name": "tempest-keypair-948545523", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:37.705917 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] validate_networks() for [('c67416e9-65e7-4c80-a421-5c4140e97b67', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:37.950303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:37.954664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:37.954664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:37.954664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:37.954664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:37.970105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:37.971848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:37.973010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:37.975179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:38.015472 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:38.023343 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for user df7a3101955b481f9a582168731ae76c and project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:38.063508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:38.063508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:38.315848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a2c18703-489a-4f61-b00b-26a5725eafa9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.651387 Jul 18 10:43:38.323340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 28/54] 10.222.0.47 () {62 vars in 1187 bytes} [Mon Jul 18 10:43:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 10:43:38.329936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:38.335515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:38.341313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:38.344137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:38.346158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:38.347097 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:38.924535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:38.926362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:38.927102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:38.927689 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:38.928129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:38.928737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:38.936168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-47224bc9-1ca8-4fba-8ebc-05196d9a736c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.609488 Jul 18 10:43:38.940524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 29/55] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:38 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:38.951498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-77f9f22d-16b2-4d3a-82a5-fd12fd6a8f23 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:38.953996 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-77f9f22d-16b2-4d3a-82a5-fd12fd6a8f23 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:38.968157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:38.968639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:38.971892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:38.972260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:39.026786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:39.036927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:39.069156 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:39.082036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:39.091706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-77f9f22d-16b2-4d3a-82a5-fd12fd6a8f23 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.101218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-77f9f22d-16b2-4d3a-82a5-fd12fd6a8f23 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1236 microversion: 2.1 time: 0.159334 Jul 18 10:43:39.102833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 30/56] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:38 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1236 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:39.110868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:39.111932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:39.130889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:39.131688 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:39.134517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:39.134517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:39.349692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d9ac59c2-cda0-4bdd-83e9-1bc535e9e894 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.084960 Jul 18 10:43:39.352450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 27/57] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 2090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:43:39.366202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:39.366946 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:39.379064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.391171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-324cf599-348a-4fa0-a4cd-96f307148f79 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.286382 Jul 18 10:43:39.394025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 31/58] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:39 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:39.408550 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-926d4ff7-7afb-4c5d-9b7b-6e7bdb0e5219 req-5ca754bb-cb6f-4733-b27d-1b8325dea21c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7026e56b-bb11-4309-9c6d-5031da4ca1d7", "tag": "e9762284-09aa-4dcd-a41a-ceeaf921c98e"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:39.419137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-926d4ff7-7afb-4c5d-9b7b-6e7bdb0e5219 req-5ca754bb-cb6f-4733-b27d-1b8325dea21c service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:39.419772 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-926d4ff7-7afb-4c5d-9b7b-6e7bdb0e5219 req-5ca754bb-cb6f-4733-b27d-1b8325dea21c service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:39.435393 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-926d4ff7-7afb-4c5d-9b7b-6e7bdb0e5219 req-5ca754bb-cb6f-4733-b27d-1b8325dea21c service nova] Creating event network-changed:e9762284-09aa-4dcd-a41a-ceeaf921c98e for instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 on hv-cinder-84617 Jul 18 10:43:39.441541 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-926d4ff7-7afb-4c5d-9b7b-6e7bdb0e5219 req-5ca754bb-cb6f-4733-b27d-1b8325dea21c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046067 Jul 18 10:43:39.443773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 32/59] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:39.459083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-819fce13-3475-4056-98b7-de8c404b88db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:39.465080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-819fce13-3475-4056-98b7-de8c404b88db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:39.525475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.525475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.525871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.525871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2a5ea3a1-0922-4e1e-b14c-226db1b3a254 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1281 microversion: 2.20 time: 0.157592 Jul 18 10:43:39.525871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 28/60] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:39 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:39.566707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-819fce13-3475-4056-98b7-de8c404b88db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:39.577818 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-819fce13-3475-4056-98b7-de8c404b88db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1241 microversion: 2.1 time: 0.132472 Jul 18 10:43:39.579379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 33/61] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:39 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:39.957297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:39.959166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:39.966862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:39.967316 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:39.968107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:39.968559 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:40.119285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:40.119885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:40.126329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:40.126787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:40.127554 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:40.127990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:40.268532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.269252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.279436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0767671e-b2f2-4101-9a44-1c89a7224e66 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.326293 Jul 18 10:43:40.280547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 29/62] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:39 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:40.297039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-26af23e4-8295-476f-93c5-d0b823d30c06 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1232 microversion: 2.1 time: 0.181406 Jul 18 10:43:40.313967 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 34/63] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:40 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1232 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:40.409724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:40.410519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:40.417533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:40.417998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:40.418750 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:40.419187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:40.543164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:40.543899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:40.691629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.698176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.700409 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.701686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c1d479dc-fb26-4a58-a066-94919b2a04ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1281 microversion: 2.20 time: 0.162397 Jul 18 10:43:40.702686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 35/64] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:40 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1281 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:43:40.710589 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-57ba794f-ff03-498b-8019-1d67b2246188 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:40.712099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-57ba794f-ff03-498b-8019-1d67b2246188 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:40.854538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-57ba794f-ff03-498b-8019-1d67b2246188 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.863784 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-57ba794f-ff03-498b-8019-1d67b2246188 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1241 microversion: 2.1 time: 0.158857 Jul 18 10:43:40.874195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 36/65] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:40 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1241 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:40.905849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:40.913802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33b63606-7b6f-49d3-8b3b-79fac0508288 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.508872 Jul 18 10:43:40.914375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 30/66] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:40 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:41.296726 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:41.297332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:41.304025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.304476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.305357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.305818 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.325168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:41.326641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:41.342210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.342655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.343732 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.344171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.643804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.651745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-872a06e9-06a7-4c41-882a-d31400d56673 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1288 microversion: 2.1 time: 0.334749 Jul 18 10:43:41.652354 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 31/67] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:41 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1288 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:41.721748 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:41.722356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:41.728524 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.728995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.729749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.730176 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.737736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.747256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-25cc95c5-ba95-41cf-b481-cecd716b4976 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.454463 Jul 18 10:43:41.748208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 37/68] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:41 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:41.834606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.842714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.844212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.845389 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1ec0444a-f3ee-4c3e-9e3b-ca3f7801c282 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1285 microversion: 2.20 time: 0.127583 Jul 18 10:43:41.845966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 32/69] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:41 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:43:41.882373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:41.882993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:41.889026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.889483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.890258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.890702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.930606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:41.931789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:41.947844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.948547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.949396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:41.954390 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:41.978223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:41.988314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f16d555e-4799-49af-afb7-dfdde633b6f4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1245 microversion: 2.1 time: 0.110294 Jul 18 10:43:41.995232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 38/70] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:41 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1245 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:42.141276 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:42.147293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-603d737c-e4e2-46c8-922a-23d5262967d9 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.220788 Jul 18 10:43:42.148036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 33/71] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:41 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:42.669480 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:42.670113 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:42.676128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.677194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:42.679936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.679936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:42.755479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:42.763937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28f84b6b-53a0-4110-9cd8-826ba1ce4bc2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1288 microversion: 2.1 time: 0.098443 Jul 18 10:43:42.764970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 39/72] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:42 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1288 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:42.766654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:42.767267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:42.777810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.778167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:42.779345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.779787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:42.867003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:42.867676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:42.879086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.882221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:42.883302 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:42.884045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.088850 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.101615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6b0ce3cb-e585-4299-8151-bf3626e89c14 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.338931 Jul 18 10:43:43.105527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 34/73] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:42 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:43.127691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:43.128573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:43.139848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.139848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.139848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.139848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.178476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.189625 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.193982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.212177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-70b94498-12a5-4032-ab98-e805842d68b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1285 microversion: 2.20 time: 0.336783 Jul 18 10:43:43.213308 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 40/74] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:42 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1285 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:43.235197 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:43.241677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:43.242204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.255030 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-419e990f-f898-4ed5-a8a1-560f3ca3819e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1237 microversion: 2.1 time: 0.137134 Jul 18 10:43:43.255662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 35/75] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:43 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1237 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:43.274466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.275309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.276272 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.276876 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.469454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.477973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-20ae777e-924e-45a2-afcd-0195344e6d82 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.260559 Jul 18 10:43:43.478816 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 41/76] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:43 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:43.781172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:43.781783 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:43.785003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:43.790020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.790471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.791682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:43.792126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:43.857795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:43.869933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a89fa25f-25f9-488b-ba6f-94ed70ec6d18 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1294 microversion: 2.1 time: 0.091632 Jul 18 10:43:43.871174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 36/77] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:43 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:44.122440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:44.123773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:44.132538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.133462 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.134468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.135116 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.231341 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:44.232153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:44.241506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.242192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.246968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.246968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.360198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:44.370329 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:44.372327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:44.378417 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-89405a37-e1ee-49ef-8734-47804dc0e492 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1341 microversion: 2.20 time: 0.150847 Jul 18 10:43:44.384812 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 37/78] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:44 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:44.386207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:44.387092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:44.397952 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.398747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.399979 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.400916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.497959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:44.512661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2a2dd79d-a4f2-4e38-8a8d-b4493354355f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.394263 Jul 18 10:43:44.529923 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 42/79] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:44 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:44.541819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:44.543169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:44.572747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.573906 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.582184 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.587794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.681802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:44.693678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fa48cc16-5898-4812-bc29-2ed609b11cfa tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1301 microversion: 2.1 time: 0.312521 Jul 18 10:43:44.694558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 38/80] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:44 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1301 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:44.888754 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:44.889471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:44.898502 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.898502 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:44.901869 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:44.902507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.051868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.061679 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-826a435b-fbee-45f6-b2c5-194b5c236e19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1294 microversion: 2.1 time: 0.176545 Jul 18 10:43:45.073878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 39/81] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:44 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1294 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:45.076335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.088899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d43ac1cd-9701-4ea3-a886-938a62c72872 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.557102 Jul 18 10:43:45.098489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 43/82] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:44 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:45.409017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:45.409017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:45.409017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.409017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.409723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.409723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.436455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:45.489391 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.504319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.506490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.507607 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-20057f21-ee21-4938-9397-9d920be2e4c5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1351 microversion: 2.20 time: 0.114344 Jul 18 10:43:45.508191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 40/83] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:45 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:45.543635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:45.544252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:45.558046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.558514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.559312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.559752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.697926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.705613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7b9b3d25-5e70-4e3e-817a-23c2670ac421 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.165671 Jul 18 10:43:45.712791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 44/84] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:45 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:45.712956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:45.712956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:45.719384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.726311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.727455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:45.727911 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:45.796821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:45.806607 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-593304a6-8e00-45e3-b622-589397d0396c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1301 microversion: 2.1 time: 0.099232 Jul 18 10:43:45.807183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 41/85] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:45 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:46.079328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:46.079944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:46.086750 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.087204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.087972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.088418 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.106542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:46.107148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:46.117414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.120237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.121299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.123088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.488062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:46.518255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-22d7971b-5529-4b09-bdc5-a80c454087bd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.442576 Jul 18 10:43:46.521965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 45/86] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:46 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:46.529733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:46.538111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:46.555803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.556941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.558099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.558672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.577243 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:46.605593 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad10d042-eeef-4214-bd29-8c433bf28451 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.503446 Jul 18 10:43:46.606682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 42/87] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:46 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:46.733580 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:46.734945 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:46.745638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.746149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.747113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:46.748379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:46.948580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:46.960660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:46.965205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:46.968611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-91e6b125-ee4a-4f20-8b0e-7fe7460d5080 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.445402 Jul 18 10:43:47.002038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 46/88] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:46 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:47.002038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:47.002038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:47.019445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.019848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.021238 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.021684 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.075403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:47.083912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-81607a99-6107-4280-af00-1d0d160add98 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.365304 Jul 18 10:43:47.084787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 43/89] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:46 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:47.146795 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:47.178875 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4a19d324-1ccc-4c6f-b822-d8a840ed3a12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1299 microversion: 2.1 time: 0.200806 Jul 18 10:43:47.181938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 47/90] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:46 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1299 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:47.540228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:47.542486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:47.555039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.558301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.561978 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.562686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.599189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-f6981752-7693-46f6-9d61-810bafa0fca2 req-c7b3ba74-505c-42eb-a393-f0abb2ed373b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77460bc-275e-4141-8386-f5ac57bddac1", "name": "network-vif-plugged", "status": "completed", "tag": "535ac1fb-1cfa-4d73-b6f3-c11a89d00401"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:47.633779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f6981752-7693-46f6-9d61-810bafa0fca2 req-c7b3ba74-505c-42eb-a393-f0abb2ed373b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.635867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f6981752-7693-46f6-9d61-810bafa0fca2 req-c7b3ba74-505c-42eb-a393-f0abb2ed373b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.719567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f6981752-7693-46f6-9d61-810bafa0fca2 req-c7b3ba74-505c-42eb-a393-f0abb2ed373b service nova] Creating event network-vif-plugged:535ac1fb-1cfa-4d73-b6f3-c11a89d00401 for instance a77460bc-275e-4141-8386-f5ac57bddac1 on hv-cinder-84617 Jul 18 10:43:47.720368 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f6981752-7693-46f6-9d61-810bafa0fca2 req-c7b3ba74-505c-42eb-a393-f0abb2ed373b service nova] Acquired lock "compute-rpcapi-router" {{(pid=124843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 10:43:47.724848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.725456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.727781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.728992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.758827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.compute.rpcapi [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 10:43:47.762818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] Releasing lock "compute-rpcapi-router" {{(pid=124843) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 10:43:47.794991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6142fe46-d7ac-4de2-8342-3472391b3322 None None] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.708885 Jul 18 10:43:47.798521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 44/91] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:47.808394 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:47.809333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:47.821578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.824709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.843317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:47.843979 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:47.984556 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:48.012967 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.031633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-86b87c1c-288f-4196-a12a-fa62b906b850 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.497889 Jul 18 10:43:48.033100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 48/92] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:47 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:48.047854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:48.052822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:48.063892 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.064476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.065641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.066761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.233204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.245551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9d0616d7-e423-4936-a7e8-d635189b1497 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.447582 Jul 18 10:43:48.251438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 45/93] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:47 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:48.258687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:48.259310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:48.278469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.285345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.287113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.287503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.772082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.774520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:48.782314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.783820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.790409 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d90071e6-0c92-4f05-8042-42144137e264 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.756266 Jul 18 10:43:48.802963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 49/94] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:48 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:48.808361 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:48.809216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:48.815909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.816353 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.817180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.817802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.931157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:48.941035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-514b7964-1df8-4e58-b15e-b9caba530993 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.693271 Jul 18 10:43:48.942740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 46/95] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:48 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:48.950635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-f6f8705d-e32d-4758-b03e-f04906c114de req-e04b221c-681a-4cc7-b38b-78b5950de14d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01418be-d04a-4364-94f0-5c85f9244d63", "tag": "3e594084-0c85-472e-8fce-f850a026f396"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:48.965358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f6f8705d-e32d-4758-b03e-f04906c114de req-e04b221c-681a-4cc7-b38b-78b5950de14d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:48.966278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f6f8705d-e32d-4758-b03e-f04906c114de req-e04b221c-681a-4cc7-b38b-78b5950de14d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:48.981693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f6f8705d-e32d-4758-b03e-f04906c114de req-e04b221c-681a-4cc7-b38b-78b5950de14d service nova] Creating event network-changed:3e594084-0c85-472e-8fce-f850a026f396 for instance f01418be-d04a-4364-94f0-5c85f9244d63 on hv-cinder-84617 Jul 18 10:43:48.991405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-f6f8705d-e32d-4758-b03e-f04906c114de req-e04b221c-681a-4cc7-b38b-78b5950de14d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044861 Jul 18 10:43:48.991405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 47/96] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:49.051767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:49.053463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:49.061857 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.063471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.065239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.066373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.242359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:49.275885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a1c3db4c-63a4-440b-973d-dec49b316961 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.470286 Jul 18 10:43:49.284358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 50/97] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:48 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:49.290946 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:49.291553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:49.297874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.298331 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.299112 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.299550 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.506279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=14 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:49.619298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:49.626728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a103df71-e20a-4214-8988-9118ba6c700d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.581125 Jul 18 10:43:49.627300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 48/98] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:49 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:49.696567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:49.709608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fc344d1f-0123-4e4d-8d72-4fbe2d77abcf tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.423931 Jul 18 10:43:49.713402 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 51/99] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:49 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:49.809034 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:49.809789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:49.817621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.817621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.818379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.818810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.822801 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177dc191-0770-4ba1-9219-e38d05c4091d", "name": "network-vif-plugged", "status": "completed", "tag": "fc4600b0-7d19-4e9b-9742-053a0a1747fd"}, {"server_uuid": "7026e56b-bb11-4309-9c6d-5031da4ca1d7", "name": "network-vif-plugged", "status": "completed", "tag": "e9762284-09aa-4dcd-a41a-ceeaf921c98e"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:49.846755 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.847466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.887121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] Creating event network-vif-plugged:fc4600b0-7d19-4e9b-9742-053a0a1747fd for instance 177dc191-0770-4ba1-9219-e38d05c4091d on hv-cinder-84617 Jul 18 10:43:49.888017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] Creating event network-vif-plugged:e9762284-09aa-4dcd-a41a-ceeaf921c98e for instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 on hv-cinder-84617 Jul 18 10:43:49.896126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-7ad96de7-7dda-4759-858d-9e385106313b req-14e216e3-247c-4838-8b09-9180a698c187 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082965 Jul 18 10:43:49.900142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 52/100] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:49.960105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:49.960794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:49.967407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.968194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:49.969004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:49.969438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.085219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.094638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.096328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.097671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a43f1639-54ad-44d6-8f96-d12613303d62 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.292774 Jul 18 10:43:50.108754 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 49/101] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:49 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:43:50.118188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-e407d3a8-df8c-4ece-b373-28e1348334b9 req-ae812bbf-dbeb-4b98-a207-ef4c5b1bdc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6158dc6a-973a-4cad-b71a-e607de559786", "tag": "5cdc2dfe-53a8-4444-ba69-41d081778649"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:50.127172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e407d3a8-df8c-4ece-b373-28e1348334b9 req-ae812bbf-dbeb-4b98-a207-ef4c5b1bdc0f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.127843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e407d3a8-df8c-4ece-b373-28e1348334b9 req-ae812bbf-dbeb-4b98-a207-ef4c5b1bdc0f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.144725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-e407d3a8-df8c-4ece-b373-28e1348334b9 req-ae812bbf-dbeb-4b98-a207-ef4c5b1bdc0f service nova] Creating event network-changed:5cdc2dfe-53a8-4444-ba69-41d081778649 for instance 6158dc6a-973a-4cad-b71a-e607de559786 on hv-cinder-84617 Jul 18 10:43:50.150730 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-e407d3a8-df8c-4ece-b373-28e1348334b9 req-ae812bbf-dbeb-4b98-a207-ef4c5b1bdc0f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042123 Jul 18 10:43:50.152078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 50/102] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:50.157548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.167253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cc78441b-063c-4959-b3a5-9327ceae0e2b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.212015 Jul 18 10:43:50.167903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 53/103] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:49 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:50.302196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:50.302196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:50.302196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.302196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.302504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.302504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.445642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.459051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5e235876-2be4-4bc1-a264-e0408677798d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.169480 Jul 18 10:43:50.467465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 51/104] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:50 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:50.644404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:50.646465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:50.652808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.653460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.654283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.654720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.730651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:50.731204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:50.737584 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.738043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.739536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:50.740051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:50.828079 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.838286 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-338a75ee-812a-481f-8a1d-f1863c76fc8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.198796 Jul 18 10:43:50.838865 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 54/105] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:50 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:50.899950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:50.911606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f32bcd1e-8d76-4b16-9676-ce22455a2913 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.184060 Jul 18 10:43:50.912292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 52/106] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:50 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:51.009038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-8659d805-8919-4010-9706-23babc8a30e1 req-49fb689b-753b-4b23-8d98-d156f23c2cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:51.012962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=14 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:51.018695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-8659d805-8919-4010-9706-23babc8a30e1 req-49fb689b-753b-4b23-8d98-d156f23c2cad service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.019420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-8659d805-8919-4010-9706-23babc8a30e1 req-49fb689b-753b-4b23-8d98-d156f23c2cad service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.043783 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-8659d805-8919-4010-9706-23babc8a30e1 req-49fb689b-753b-4b23-8d98-d156f23c2cad service nova] Creating event network-changed:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:43:51.049157 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-8659d805-8919-4010-9706-23babc8a30e1 req-49fb689b-753b-4b23-8d98-d156f23c2cad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045114 Jul 18 10:43:51.049755 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 55/107] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:43:51.115626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:51.116240 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:51.122444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.122895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.123660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.124095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.185370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:51.186074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:51.193369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.197806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.197806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.197806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.348429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:51.360529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:51.362568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:51.365684 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-076d79bf-4d98-4646-9e64-8bfddaa9005f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.252322 Jul 18 10:43:51.366265 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 53/108] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:51 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:51.420582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:51.428825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d60da0bb-46cf-4f8a-8ae4-d5bfe7896e7b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.247689 Jul 18 10:43:51.429395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 56/109] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:51 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:51.476767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:51.477324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:51.483466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.483929 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.484709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.485149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.693712 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:51.704207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5236eb5b-f583-4290-9531-b247740abcc7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.231428 Jul 18 10:43:51.705206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 54/110] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:51 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:51.857873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:51.858504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:51.865638 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.866080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.866834 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.867267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.929468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:51.932129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:51.951929 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.952376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:51.953173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:51.953667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.334634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.342936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-03c644f8-db43-47b8-b4a5-6d77377cb2e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.489866 Jul 18 10:43:52.343522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 57/111] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:51 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:52.353569 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.362064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-94eb7022-3222-403f-9423-755cff449c1e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.437263 Jul 18 10:43:52.362843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 55/112] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:51 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:52.384204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:52.384895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:52.391329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.391788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.392552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.393040 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.445966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:52.447081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:52.460037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.460037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.460896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.461332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.572457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.591841 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.593421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.602977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-180aabb8-cb05-4054-b07c-52ea9e5dd685 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.223355 Jul 18 10:43:52.604440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 58/113] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:52 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:52.692536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.701636 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1cfda072-5008-4df0-ad8c-f0768701c79c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1321 microversion: 2.1 time: 0.259811 Jul 18 10:43:52.702431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 56/114] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:52 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:52.724943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:52.726118 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:52.735948 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.741338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.742549 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:52.743004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:52.886146 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:52.893724 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a5463252-c5e8-4c43-89f2-3b1017c76344 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.175323 Jul 18 10:43:52.898014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 59/115] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:52 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:53.361295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:53.361904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.368664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.369142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.369899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.370332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.379171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:53.379815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.385866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.386317 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.387110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.387548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.567804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.576558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aaaa4c2a-50f8-41c0-be2c-8b04dc0efaa8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.219058 Jul 18 10:43:53.577688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 57/116] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:53 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:53.590581 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.598979 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4a69b081-867d-4d09-93cc-b4fb08fa785a tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.223529 Jul 18 10:43:53.599707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 60/117] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:53 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:53.622060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:53.623040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.629472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.630073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.631038 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.631546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.719759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:53.720593 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.731086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.731086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.731086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.731086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.765534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.769428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:53.778632 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.780453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.781982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07880460-eb55-45b7-8b77-74a3b6f0b85c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.163848 Jul 18 10:43:53.782901 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 58/118] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:53 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:53.871722 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:53.880371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0114900b-14c4-4562-b120-21bfc3d8f895 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1515 microversion: 2.1 time: 0.164016 Jul 18 10:43:53.880981 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 61/119] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:53 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1515 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:53.906792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:53.907788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.915912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:53.920210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.920661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.921490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.922080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.930240 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:53.944829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.945528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:53.946451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:53.947032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.037278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'flavor' on Instance uuid a77460bc-275e-4141-8386-f5ac57bddac1 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:43:54.157285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:54.166365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3466ed2a-a404-48de-8fe7-bdbff6e8ec71 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.254098 Jul 18 10:43:54.176720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 62/120] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:53 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:54.595151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:54.595759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:54.602974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.615541 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.616637 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.618279 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.652650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-72240df9-4f4e-469e-8014-b8b8d365aee9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1/action" status: 200 len: 32 microversion: 2.1 time: 0.748280 Jul 18 10:43:54.652650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 59/121] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:43:53 2022] POST /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1/action => generated 32 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:43:54.667095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:54.667960 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:54.682660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.683383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.684491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.685140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.833363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:54.841426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8ce3d1d6-3c2c-4ced-9c8e-55611c014a47 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.250236 Jul 18 10:43:54.842005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 63/122] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:54 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:54.846832 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:54.857729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:54.857729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.857729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.857729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.858220 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.872957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:54.880531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0e3f4e72-3116-4daf-a237-9def5bc71db2 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1315 microversion: 2.1 time: 0.226249 Jul 18 10:43:54.881140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 60/123] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:54 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:54.885542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:54.886312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:54.892450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.903403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:54.903403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:54.903403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.035267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:55.044172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b07c9e6d-b8db-44bb-87f5-410fbe4fcf11 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.200906 Jul 18 10:43:55.044966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 64/124] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:54 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:55.067237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:55.075932 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:55.076823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:55.077933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-983926e2-24e2-4ce0-a1d1-cc0eac6bd0e1 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.195882 Jul 18 10:43:55.078493 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 61/125] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:54 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:55.183392 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:55.184007 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:55.190197 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.190653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.191410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.192450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.328921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:55.336870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a9e55206-912e-4caf-9d67-bfbb42f51699 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.157300 Jul 18 10:43:55.337435 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 65/126] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:55 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:55.858958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:55.859558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:55.866092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.866533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.867284 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.867716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.897666 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:55.898632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:55.904413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:55.909599 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.911447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:55.914005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:55.914005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.053915 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.061657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e9b44269-5111-41e6-81ed-a201cd7ecc20 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.206606 Jul 18 10:43:56.062232 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 62/127] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:55 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:56.066800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:56.067415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:56.073310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.073776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.074531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.074958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.080799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.089248 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0964f64a-73f4-4498-b449-472decac41d4 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1502 microversion: 2.1 time: 0.196141 Jul 18 10:43:56.089822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 66/128] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:55 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1502 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:56.099391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:56.100141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:56.106681 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.107123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.108046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.109032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.263918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.274777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8c6c2ff3-296e-41f5-9e52-4eb1f35eb23b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.209366 Jul 18 10:43:56.277146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 63/129] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:56 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:56.293965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.297584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:56.302964 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.304690 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.309270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5a7cde69-9f7f-4e46-8269-7b4982cd44ae tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.211081 Jul 18 10:43:56.309270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 67/130] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:56 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:43:56.353059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:56.353675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:56.359969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.360425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.361247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:56.361688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:56.497887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:56.505972 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6dcc36d-cb7b-4019-aa74-10e0b7eb389c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.156701 Jul 18 10:43:56.506745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 64/131] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:56 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:57.079351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:57.080218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:57.086772 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.087371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.087982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.088419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.222633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.230601 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ac46d7b2-767d-4cdf-bb4e-cbd111cb17ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.155030 Jul 18 10:43:57.231175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 68/132] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:57 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:57.290877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:57.291493 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:57.297600 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.298048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.298819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.299255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.326253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:57.327064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:57.334440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.341184 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.341184 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.341184 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.483003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.491029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-90cef6d9-e010-4fd8-8290-157fc4d200fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.204109 Jul 18 10:43:57.491838 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 65/133] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:57 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:57.514720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.523047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:57.523223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.523792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:57.524983 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.526096 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b14b55c8-c3c5-4b69-9c0a-f069be1b5246 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.204176 Jul 18 10:43:57.526670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 69/134] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:57 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:43:57.530134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.530581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.531348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:57.531784 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:57.754685 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:43:57.849956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:57.858031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5d0226d4-bd68-44e5-b2a2-06905ee5f52a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.338853 Jul 18 10:43:57.870769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 66/135] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:57 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:58.248115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:58.248652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:58.258963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.259634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.260558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.261285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.461934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:58.471898 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ac09319c-6607-4ced-9bf7-954b03b502f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.227755 Jul 18 10:43:58.473012 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 70/136] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:58 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:58.508624 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:58.509918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:58.516655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.517204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.517980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.518413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.546035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:58.546756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:58.553989 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.554529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.555519 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.556109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.711076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:58.723838 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9029c3ae-0696-4487-bb59-68a05bf8040b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.219378 Jul 18 10:43:58.736110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 67/137] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:58 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:58.736110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-792221710", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "networks": [{"uuid": "ae7ec4d1-f13d-4127-bcd6-3269473466ec"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:58.749100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:58.759013 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:58.761278 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:58.768823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0a8ae7d4-20e7-46b0-8c66-1101e674a55b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.221370 Jul 18 10:43:58.768823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 71/138] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:43:58 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:43:58.796736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] validate_networks() for [('ae7ec4d1-f13d-4127-bcd6-3269473466ec', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:43:58.887120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:58.887795 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:58.894105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.895253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:58.896378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:58.899485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.116168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:59.123924 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0b8a0d53-3dec-495f-97e7-c838dd936c98 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.241106 Jul 18 10:43:59.124598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 72/139] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:58 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:43:59.130224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "190facb4-112f-4c82-b7c7-1f6546235e1f"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:43:59.131421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:59.137531 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.138044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.138891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.139385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.245507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:43:59.245928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:43:59.246401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:43:59.246803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:43:59.247212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:43:59.261825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.261825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.261825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.261825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.278801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Getting quotas for project bac9bcfdd4ef4a6d87f593bde0c352c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:43:59.283040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Getting quotas for user f862a8b7b4534d1ba7d65b4688c32b92 and project bac9bcfdd4ef4a6d87f593bde0c352c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:43:59.294861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:43:59.297142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:43:59.628201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8bf4640d-9fb5-4f3e-a9a9-8e5446746bc2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.900321 Jul 18 10:43:59.636010 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 68/140] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:43:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:43:59.647972 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:59.649398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:59.660799 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.662001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.663111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.663701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.872913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:59.881086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0c5689a8-583d-41fd-bdba-16dbc04f0203 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.243659 Jul 18 10:43:59.881647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 69/141] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:59 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:59.886258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aa6e4518-c567-41c8-9c48-2e8804803435 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:59.886865 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-aa6e4518-c567-41c8-9c48-2e8804803435 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:59.937180 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-aa6e4518-c567-41c8-9c48-2e8804803435 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:43:59.944074 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aa6e4518-c567-41c8-9c48-2e8804803435 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1218 microversion: 2.1 time: 0.061326 Jul 18 10:43:59.952331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 70/142] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:59 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1218 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:43:59.952331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:43:59.952331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:43:59.956198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.956645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:43:59.957555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:43:59.958340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.096717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:00.104669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f852acf4-290b-4a7e-aa59-82fee805ac00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.159063 Jul 18 10:44:00.105270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 71/143] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:43:59 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:00.109725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:00.110340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:00.117084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.117531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.118463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.118896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.256980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:00.268246 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:00.270338 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:00.271449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-624b7b07-3c08-40b4-8dc3-fd390b8ec742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.165300 Jul 18 10:44:00.272046 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 72/144] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:00 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:00.276781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-62e4700a-9c0e-434c-997f-732f08900bf4 req-b1063715-1454-476b-89a8-79364e71ea55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "name": "network-vif-plugged", "status": "completed", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:00.288152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-62e4700a-9c0e-434c-997f-732f08900bf4 req-b1063715-1454-476b-89a8-79364e71ea55 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.290112 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-62e4700a-9c0e-434c-997f-732f08900bf4 req-b1063715-1454-476b-89a8-79364e71ea55 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.307285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-62e4700a-9c0e-434c-997f-732f08900bf4 req-b1063715-1454-476b-89a8-79364e71ea55 service nova] Creating event network-vif-plugged:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:44:00.316767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-62e4700a-9c0e-434c-997f-732f08900bf4 req-b1063715-1454-476b-89a8-79364e71ea55 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043114 Jul 18 10:44:00.317363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 73/145] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:00.323848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:00.324552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:00.331047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.331499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.332775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.333212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.464249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:00.471884 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c0bc7467-4b18-4c07-899a-428cd5b917b2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.153283 Jul 18 10:44:00.472632 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 74/146] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:00 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:00.723126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d048314-b61b-48ad-b5b1-07cf4ff1cdd0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "POST /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.597173 Jul 18 10:44:00.724454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 73/147] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:43:59 2022] POST /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7/os-volume_attachments => generated 194 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:00.898976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:00.899694 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:00.905666 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.910603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.910603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:00.910603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:00.970800 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-60f659a3-918b-4f56-a255-04d2aa882268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:00.971791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-60f659a3-918b-4f56-a255-04d2aa882268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:01.043860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-60f659a3-918b-4f56-a255-04d2aa882268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.050796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-60f659a3-918b-4f56-a255-04d2aa882268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1218 microversion: 2.1 time: 0.084580 Jul 18 10:44:01.051399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 74/148] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:00 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:01.075061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.078595 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:01.083748 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0e8f230b-b7a6-4605-8d1a-10d91c51ebef tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.189504 Jul 18 10:44:01.084326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 75/149] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:00 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:01.121928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:01.122600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:01.128953 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.129547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.130342 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.130822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.260001 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.267754 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-84342f93-4ccd-4b1d-b979-9de9186b5f41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.149595 Jul 18 10:44:01.276378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 75/150] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:01 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:01.290459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:01.291118 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:01.297107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.297549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.298326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.298757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.431887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.439775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.441904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.442993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d1a7a42e-4e33-40f8-9897-6ac6e6e6bc3d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.156585 Jul 18 10:44:01.443542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 76/151] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:01 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:01.488858 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:01.489471 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:01.495403 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.495841 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.496587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:01.497042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:01.623559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:01.631616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6f8db409-eb90-4eb5-9dcc-e2565f5f200c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.146846 Jul 18 10:44:01.632992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 76/152] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:01 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:02.067651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:02.068267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:02.074327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.074779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.075557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.078863 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.101832 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:02.102534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:02.109279 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.109870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.114104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.114913 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.141595 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.149980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-abe02de8-c97f-4f6d-b60b-c07717aaeab1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1222 microversion: 2.1 time: 0.086177 Jul 18 10:44:02.150558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 77/153] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:02 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1222 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:02.250862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.259098 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-73053709-4c93-4c38-a5dc-26a6baf37e87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.162047 Jul 18 10:44:02.259673 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 77/154] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:02 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:02.285465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:02.286234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:02.289148 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:02.292540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.293019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.293789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.294225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.331638 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-c6d6dbe9-6c14-405d-a2b1-5f9994da81db req-681f7157-2b9e-476e-a729-1e5ba338e208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01418be-d04a-4364-94f0-5c85f9244d63", "name": "network-vif-plugged", "status": "completed", "tag": "3e594084-0c85-472e-8fce-f850a026f396"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:02.340605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c6d6dbe9-6c14-405d-a2b1-5f9994da81db req-681f7157-2b9e-476e-a729-1e5ba338e208 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.341092 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c6d6dbe9-6c14-405d-a2b1-5f9994da81db req-681f7157-2b9e-476e-a729-1e5ba338e208 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.352307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-c6d6dbe9-6c14-405d-a2b1-5f9994da81db req-681f7157-2b9e-476e-a729-1e5ba338e208 service nova] Creating event network-vif-plugged:3e594084-0c85-472e-8fce-f850a026f396 for instance f01418be-d04a-4364-94f0-5c85f9244d63 on hv-cinder-84617 Jul 18 10:44:02.357611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-c6d6dbe9-6c14-405d-a2b1-5f9994da81db req-681f7157-2b9e-476e-a729-1e5ba338e208 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030198 Jul 18 10:44:02.358208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 78/155] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:02.423773 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.431302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-34951ce0-ac63-48cf-b10c-acd298dd747c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.149800 Jul 18 10:44:02.431866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 78/156] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:02 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:02.462494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:02.463219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:02.469537 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.469986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.470794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.471234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.602904 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.611182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.612700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.615516 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b5e62c7c-8cbc-47f5-a260-3809226b42b3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.157154 Jul 18 10:44:02.616086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 79/157] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:02 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:02.649441 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:02.650049 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:02.656366 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.656845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.657591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:02.658023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:02.810045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:02.818080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28953997-a27a-4c42-bf48-7a1a0d2a60fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.172564 Jul 18 10:44:02.818841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 79/158] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:02 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:03.170140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:03.171614 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:03.180950 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.181804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.182847 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.183563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.274105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.276877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:03.278118 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:03.283044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-71bb0373-1ecf-4dab-81b1-d3227499aa79 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1214 microversion: 2.1 time: 0.119093 Jul 18 10:44:03.284045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 80/159] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:03 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1214 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:03.286487 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.286936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.288051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.288350 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.439479 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.447741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:03.448356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:03.453293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-973e485d-d365-42cf-9520-e50105b91a27 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.175486 Jul 18 10:44:03.453293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 80/160] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:03 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:03.455658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.456075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.456921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.458075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.601866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.609333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ab0925af-1250-4d0d-8efd-bc28e0cbe835 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.165342 Jul 18 10:44:03.619089 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 81/161] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:03 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:03.634193 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:03.634823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:03.640883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.641328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.642087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.642682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.784622 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.793128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.794551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.795657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2c9ecbb1-e615-480f-9385-dd2fd58af693 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.165645 Jul 18 10:44:03.796207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 81/162] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:03 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:03.835412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:03.836074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:03.842099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.842730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.843513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:03.843948 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:03.977852 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:03.985353 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-24ab38c2-f8b1-4d79-b70c-bca55cd25a01 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.154005 Jul 18 10:44:03.985921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 82/163] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:03 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:04.300544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:04.301342 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:04.307464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.307916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.308673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.309123 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.371736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-28065ce0-3826-4104-a1a4-0f58a00829d2 req-5ef56983-d4af-4433-acfe-3cda41f67307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6158dc6a-973a-4cad-b71a-e607de559786", "name": "network-vif-plugged", "status": "completed", "tag": "5cdc2dfe-53a8-4444-ba69-41d081778649"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:04.372509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.380551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-69fd0393-d048-4254-b4ac-45432f2ae06a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1270 microversion: 2.1 time: 0.083889 Jul 18 10:44:04.382069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-28065ce0-3826-4104-a1a4-0f58a00829d2 req-5ef56983-d4af-4433-acfe-3cda41f67307 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.383329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-28065ce0-3826-4104-a1a4-0f58a00829d2 req-5ef56983-d4af-4433-acfe-3cda41f67307 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.388217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 82/164] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:04 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:04.397118 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-28065ce0-3826-4104-a1a4-0f58a00829d2 req-5ef56983-d4af-4433-acfe-3cda41f67307 service nova] Creating event network-vif-plugged:5cdc2dfe-53a8-4444-ba69-41d081778649 for instance 6158dc6a-973a-4cad-b71a-e607de559786 on hv-cinder-84617 Jul 18 10:44:04.402368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-28065ce0-3826-4104-a1a4-0f58a00829d2 req-5ef56983-d4af-4433-acfe-3cda41f67307 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034023 Jul 18 10:44:04.403106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 83/165] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:04.466304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:04.466949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:04.473667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.474113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.474883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.475316 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.604976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.612220 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-05b090fa-b35e-4ffc-85d5-bbe0b083ec02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.149915 Jul 18 10:44:04.612808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 83/166] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:04 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:04.627052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:04.627745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:04.634394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.634838 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.635598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.636036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.764773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.772125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-58052856-5959-489d-ac06-60bf3a8ebcf7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.149294 Jul 18 10:44:04.772720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 84/167] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:04 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:04.818546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:04.819205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:04.825527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.825961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.826711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:04.827185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:04.960335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.968172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.969683 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:04.970770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce7b631f-38d7-4cab-968c-361dde5a4e20 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.157185 Jul 18 10:44:04.971326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 84/168] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:04 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:05.010728 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:05.011333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:05.017415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.017850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.018597 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.019019 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.033402 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:05.148488 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:05.156213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c6c772c-4313-46fa-bba7-a7dca67a4bbf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.149347 Jul 18 10:44:05.156796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 85/169] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:05 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:05.402463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:05.402980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:05.409222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.409709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.411203 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.411644 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.475057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:05.482512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-14cc0751-48a5-48b3-8535-0e4cf15c0926 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1270 microversion: 2.1 time: 0.089035 Jul 18 10:44:05.483068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 85/170] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:05 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:05.629757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:05.630646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:05.637299 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.637736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.638494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.638929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.772020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:05.779256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4f7865e3-59f6-4986-aca9-b0a9213989f7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.153920 Jul 18 10:44:05.779815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 86/171] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:05 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:05.789576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:05.790232 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:05.796236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.796698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.797475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.797908 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.928951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:05.936492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fd02f0c7-6e6d-46e6-bdcb-71d50a2a4be6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.151559 Jul 18 10:44:05.937018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 86/172] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:05 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:05.989465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:05.990089 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:05.996617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.997092 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:05.997854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:05.998291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.129851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.137800 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.139321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.140448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ef954b82-db7c-4af0-afe8-dd861548686f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.155549 Jul 18 10:44:06.141032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 87/173] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:05 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:06.172517 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:06.173157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:06.179257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.179696 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.180448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.180912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.309303 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.317657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d15b1d1a-6ddb-4a0f-9ca6-96f36dcf4a66 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.148950 Jul 18 10:44:06.318222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 87/174] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:06 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:06.499134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:06.499748 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:06.506905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.507368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.508161 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.508543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.570447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.577926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a6cd5bb1-d037-4719-84d4-7bc1de00311f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1270 microversion: 2.1 time: 0.082543 Jul 18 10:44:06.578485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 88/175] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:06 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1270 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:06.797126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:06.797737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:06.804471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.805039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.805796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.806236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.942491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:06.951566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1400a95b-7abb-4a8d-8b3a-f4c0b208df17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.158222 Jul 18 10:44:06.952126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 88/176] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:06 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:06.953926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:06.954579 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:06.962067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.962520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:06.963287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:06.963722 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.091382 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.099265 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1a300c31-4105-4dd3-a415-6c4350ebc05d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.149361 Jul 18 10:44:07.099834 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 89/177] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:06 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:07.158940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:07.159544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:07.165738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.166213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.166964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.170138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.300885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.309172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.310740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.311837 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b29309fc-92e4-403e-93d8-b3eb5a666cf9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1407 microversion: 2.20 time: 0.156791 Jul 18 10:44:07.312395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 89/178] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:07 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:07.334820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:07.335444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:07.344633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.344633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.344633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.344633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.470397 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.478584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-df2b5b68-e950-465d-9a07-7c516ce208f7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.147661 Jul 18 10:44:07.479150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 90/179] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:07 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:07.594610 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:07.595290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:07.602094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.603380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.603380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.603703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.663789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:07.671347 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9916e6bc-abd6-4e5c-a4f6-13e40e3e14cc tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1270 microversion: 2.1 time: 0.080561 Jul 18 10:44:07.671895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 90/180] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:07 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1270 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:07.968646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:07.969285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:07.976595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.977076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:07.977854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:07.978291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.112799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.116290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:08.116957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:08.120548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7e57f1d-2b69-40a8-85ed-63c24002e83f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.155668 Jul 18 10:44:08.121161 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 91/181] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:07 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:08.123085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.123633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.124555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.125020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.264587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.273903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-021c0fff-dd64-43f5-a646-cb80c39871d2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.161512 Jul 18 10:44:08.274472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 91/182] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:08 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:08.330874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:08.331476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:08.338209 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.338654 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.339405 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.339835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.479552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.487862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.489396 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.490543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9d805386-d74f-4202-91c3-242884b07a01 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1599 microversion: 2.20 time: 0.163962 Jul 18 10:44:08.491102 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 92/183] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:44:08 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:44:08.495889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:08.496519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:08.503530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.503530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.503972 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.504400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.510631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:08.511160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:08.517375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.517827 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.518584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.519024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.524317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:08.630972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5a7d6c5f-3ff2-40f7-a94a-36eaf0adcb5a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.123624 Jul 18 10:44:08.631854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 93/184] 10.222.0.47 () {60 vars in 1315 bytes} [Mon Jul 18 10:44:08 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:44:08.678903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.688064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27026bf0-c407-4ab6-afd7-9252ddb621d6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.196112 Jul 18 10:44:08.688470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:08.689130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 92/185] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:08 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:08.689239 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:08.696538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.697068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.697840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:08.698424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:08.767726 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:08.776616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3da94e33-284d-4b11-ba1f-a601bfd5a9b1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1278 microversion: 2.1 time: 0.091818 Jul 18 10:44:08.777236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 94/186] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:08 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1278 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:09.139305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:09.140043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:09.151194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.152670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.154659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.157310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.271322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:09.292385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:09.305474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:09.323524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.325622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.326434 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.326891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.357645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:09.366932 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ee523df-9219-4a71-8792-077ec8fc4d31 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1361 microversion: 2.1 time: 0.232109 Jul 18 10:44:09.368201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 93/187] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:09 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:09.479329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:09.486796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6dd8141d-9876-4a26-a65f-29351d18c5bb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.199271 Jul 18 10:44:09.487360 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 95/188] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:09 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:09.706469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:09.707171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:09.713498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.713941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.714702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.715122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.795711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:09.796425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:09.804212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.805008 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.806029 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:09.806672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:09.891920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:09.904371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-527cfdad-8c98-4743-b93e-997af940ed62 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1288 microversion: 2.1 time: 0.112568 Jul 18 10:44:09.907449 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 96/189] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:09 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1288 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:09.932639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:09.941873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cdfe11a4-c5b8-4338-9f81-210cbbd0d174 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.239577 Jul 18 10:44:09.943694 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 94/190] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:09 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:10.384410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:10.385062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:10.391546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.391992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.392777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.393206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.505302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:10.506827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:10.514264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=8 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:10.516479 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.517193 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.518478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.519116 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.538557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:10.546079 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-69497f82-13d1-4299-9c94-91532b2cde79 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1547 microversion: 2.1 time: 0.165436 Jul 18 10:44:10.546964 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 97/191] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:10 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:10.552222 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-9352e09a-d8ee-4a6a-a388-450ed8a337ff req-d2966843-e9f1-4688-babb-43a931122989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:10.564211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9352e09a-d8ee-4a6a-a388-450ed8a337ff req-d2966843-e9f1-4688-babb-43a931122989 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.564907 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9352e09a-d8ee-4a6a-a388-450ed8a337ff req-d2966843-e9f1-4688-babb-43a931122989 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.588854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-9352e09a-d8ee-4a6a-a388-450ed8a337ff req-d2966843-e9f1-4688-babb-43a931122989 service nova] Creating event network-changed:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:44:10.604096 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-9352e09a-d8ee-4a6a-a388-450ed8a337ff req-d2966843-e9f1-4688-babb-43a931122989 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055707 Jul 18 10:44:10.607284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 98/192] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:10.623231 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:10.625757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:10.638344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.638803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.639583 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.640005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.757877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-27dc0512-7add-4fb3-9582-c5520ea3fe42 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149319 Jul 18 10:44:10.758551 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 99/193] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:44:10 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-interface => generated 284 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:10.760955 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:10.768484 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9c3e1080-af9c-4a1d-94d6-c1de58d1efc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.268426 Jul 18 10:44:10.777955 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 95/194] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:10 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:10.923020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:10.923951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:10.930917 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.931370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.932147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.932580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.961288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:10.962218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:10.980962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.981644 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:10.982423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:10.983008 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:11.048570 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:11.134957 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:11.147495 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f9ce475c-ad37-4996-964a-cee37d1948a5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.228259 Jul 18 10:44:11.158298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 100/195] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:10 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:11.173032 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:11.182769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-676e2c9a-4be8-4c89-868c-a8482bdf4bed tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.226582 Jul 18 10:44:11.183424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 96/196] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:10 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:11.784262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:11.785584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:11.792430 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:11.792918 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:11.793688 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:11.794125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:11.931324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:11.940757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5c2e792-bbf7-4eea-9d6b-8b7bf4ed6204 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.160189 Jul 18 10:44:11.942022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 101/197] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:11 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:12.165293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:12.166941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:12.173465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.173916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.174769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.175266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.203335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:12.203950 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:12.211678 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.212129 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.212930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.213405 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.370757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:12.378202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7833e46f-626f-4dae-b092-24813fd30cdb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.217084 Jul 18 10:44:12.378796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 97/198] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:12 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:12.392289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:12.400277 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-abf9702f-5ce6-464e-bead-579ffb64afcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.200795 Jul 18 10:44:12.406704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 102/199] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:12 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:12.624295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-5e89c90b-cf15-4dca-8de8-24ac8d3b405f req-3e536a2c-fda9-431c-a509-ee12966063a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f01418be-d04a-4364-94f0-5c85f9244d63", "tag": "3e594084-0c85-472e-8fce-f850a026f396"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:12.633921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5e89c90b-cf15-4dca-8de8-24ac8d3b405f req-3e536a2c-fda9-431c-a509-ee12966063a5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.634376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5e89c90b-cf15-4dca-8de8-24ac8d3b405f req-3e536a2c-fda9-431c-a509-ee12966063a5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.646122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-5e89c90b-cf15-4dca-8de8-24ac8d3b405f req-3e536a2c-fda9-431c-a509-ee12966063a5 service nova] Creating event network-changed:3e594084-0c85-472e-8fce-f850a026f396 for instance f01418be-d04a-4364-94f0-5c85f9244d63 on hv-cinder-84617 Jul 18 10:44:12.651277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-5e89c90b-cf15-4dca-8de8-24ac8d3b405f req-3e536a2c-fda9-431c-a509-ee12966063a5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030598 Jul 18 10:44:12.651871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 98/200] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:12.958990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:12.959657 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:12.966698 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.967142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.967909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:12.968338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:12.983856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:13.111449 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:13.121617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0642be7e-c700-4a16-8005-6e2de3c52ff7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.167115 Jul 18 10:44:13.122213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 103/201] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:12 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:13.397335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:13.398056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:13.404551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:13.405026 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:13.405793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:13.406222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:13.423375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:13.423982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:13.431452 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:13.431901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:13.432672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:13.433130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:13.615557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:13.623288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8454deb-9a8c-4208-a86b-4aa28d91425a tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.230548 Jul 18 10:44:13.623880 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 99/202] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:13 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:13.643953 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:13.651879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0eb3adfe-bde8-4d44-9c47-6f2ae018d28a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.233423 Jul 18 10:44:13.652474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 104/203] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:13 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:14.141128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:14.145904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:14.148576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.149051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.149820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.150254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.310421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:14.318786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3f6f0a0f-762a-41a2-95cb-a47a087e99d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.181389 Jul 18 10:44:14.319439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 100/204] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:14 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:14.639934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:14.640504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:14.649530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.649971 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.650932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.651514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.671365 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:14.672088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:14.678949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.679682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.680658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:14.681319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:14.856412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:14.859720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:14.873165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6fbd59b3-3666-4ae7-8f01-feb7ac867b40 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.206432 Jul 18 10:44:14.873749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 101/205] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:14 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:14.879992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ed46ef1b-143b-446f-8ed8-3ae0602bcff5 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.243180 Jul 18 10:44:14.882843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 105/206] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:14 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:15.213540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-7dc1535d-66e0-4b92-a845-ba9d4f076513 req-0c79896d-cee1-4df1-9bd4-de0e37c66999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dec0babc-bd9d-46f7-9045-011b4cbb5356", "tag": "81ec280a-fd52-4eaf-8791-4aadd2f2c0bf"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:15.221744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7dc1535d-66e0-4b92-a845-ba9d4f076513 req-0c79896d-cee1-4df1-9bd4-de0e37c66999 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.222184 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7dc1535d-66e0-4b92-a845-ba9d4f076513 req-0c79896d-cee1-4df1-9bd4-de0e37c66999 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.234828 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-7dc1535d-66e0-4b92-a845-ba9d4f076513 req-0c79896d-cee1-4df1-9bd4-de0e37c66999 service nova] Creating event network-changed:81ec280a-fd52-4eaf-8791-4aadd2f2c0bf for instance dec0babc-bd9d-46f7-9045-011b4cbb5356 on hv-cinder-84617 Jul 18 10:44:15.240770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-7dc1535d-66e0-4b92-a845-ba9d4f076513 req-0c79896d-cee1-4df1-9bd4-de0e37c66999 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030871 Jul 18 10:44:15.241359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 102/207] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:15.335986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:15.336595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:15.342582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.343031 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.343797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.344232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.475854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:15.483913 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-092cf602-4d84-47b4-af7d-57f2b39b1869 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.151950 Jul 18 10:44:15.489166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 106/208] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:15 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:15.891324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:15.892012 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:15.898701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.899142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.899352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:15.900516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.900607 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:15.900724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.906606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.907056 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:15.907825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:15.908256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:16.282773 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:16.286444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:16.290591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a887fc01-5bde-47cd-882c-bc0cdb967dde tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.403543 Jul 18 10:44:16.291164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 103/209] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:15 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:16.294123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e8f587c-55b2-4338-baa6-09576b580d5f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.398541 Jul 18 10:44:16.294694 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 107/210] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:15 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:16.500945 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:16.501537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:16.508216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:16.508739 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:16.509565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:16.509978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:16.640036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:16.648464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9fad4cd4-7aa9-4709-88ac-18a77eb87e52 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.151513 Jul 18 10:44:16.649136 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 104/211] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:16 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:17.307598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:17.308158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:17.310676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:17.311324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:17.314976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.315667 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.317155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.317570 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.317866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.318317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.319083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.319642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.513258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:17.516469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:17.520993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28c8dff3-988a-40ef-980a-bab363143f69 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.217060 Jul 18 10:44:17.521505 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 108/212] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:17 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:17.524169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e91f3c18-6243-4b37-83b6-6a74f6a9eb07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.217225 Jul 18 10:44:17.524801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 105/213] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:17 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:17.665703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:17.666319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:17.672477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.672960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.673783 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:17.674218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:17.799691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:17.807293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fd790418-d4cb-4795-a825-de9331b41053 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.145465 Jul 18 10:44:17.807850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 109/214] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:17 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:18.538449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:18.539751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:18.546409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.546966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:18.548020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.548553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:18.550587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:18.551401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:18.559593 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.563680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:18.563680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.563680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:18.884717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:18.897919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d5d50bec-f309-43b6-bd39-83bdd9b59dd3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.364269 Jul 18 10:44:18.898089 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:18.905578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-480c1298-ef46-4a58-8b1b-95c1c941fa33 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.360315 Jul 18 10:44:18.911070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 110/215] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:18 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:18.911920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:18.912457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:18.913928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 106/216] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:18 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:18.918521 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.918968 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:18.920002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:18.920438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.056522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:19.064150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f68255e4-4403-487c-ade7-a116e59ac57d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.157028 Jul 18 10:44:19.064791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 111/217] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:18 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:19.209849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:19.210214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:19.216450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.216942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.217711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.218147 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.243640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:44:19.569736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9579ebc5-2540-43ab-ae39-ef6e43374e93 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 204 len: 0 microversion: 2.1 time: 0.371567 Jul 18 10:44:19.570436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 107/218] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:44:19 2022] DELETE /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:44:19.578555 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:19.579139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:19.586151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.586598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.587363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.587798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.718322 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:19.727284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-67a323be-e821-43a7-b3aa-8d5e93e4470e tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.152459 Jul 18 10:44:19.728210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 112/219] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:19 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:19.916209 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:19.916941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:19.923078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.923528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.924288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.924816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.925321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:19.925925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:19.931856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.932304 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:19.933083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:19.933517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:20.119951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:20.123495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:20.124251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:20.127813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2b4a054e-6f18-4399-9c29-060b0815932b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.215947 Jul 18 10:44:20.128382 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 108/220] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:19 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:20.132395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-731f8271-f03b-4b5d-8fd0-e17520f91d38 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.210945 Jul 18 10:44:20.132999 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 113/221] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:19 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:20.139705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:20.139705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:20.140393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:20.140896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:20.141653 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:20.142085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:20.276463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:20.282790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8095bfee-3f58-49ce-bec0-336b9fbef572 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.153459 Jul 18 10:44:20.283343 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 109/222] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:20 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:20.745149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:20.745778 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:20.752242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:20.752707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:20.753452 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:20.753878 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:20.881406 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:20.889308 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-14f23f40-b3b5-4da2-9af9-13dab2a32b78 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.148056 Jul 18 10:44:20.889865 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 114/223] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:20 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:21.145201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:21.145779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:21.152031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.152482 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.153267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.153706 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.154622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:21.155232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:21.157117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:21.162571 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.163022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.163780 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.164211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.350347 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:21.353822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:21.357776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62523ce0-bd39-457b-ae06-7d3ce054263c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.216453 Jul 18 10:44:21.358349 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 110/224] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:21 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:21.361412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-afadd462-3208-4d12-b7d1-ac1ef9d574d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.210551 Jul 18 10:44:21.362117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 115/225] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:21 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:21.362680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:21.363329 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:21.369201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.369653 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.370416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.370848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.502386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:21.509969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8152aca6-e8ab-4606-a4ee-7e31a80c5cba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.150688 Jul 18 10:44:21.510539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 111/226] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:21 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:21.906192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:21.906804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:21.913878 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.914325 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:21.920901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:21.920901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.043895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:22.051760 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eae41bc8-f41a-4915-8a8d-ff2c1aaf75a0 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.149411 Jul 18 10:44:22.052371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 116/227] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:21 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:22.374873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:22.375472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:22.377167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:22.377777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:22.382281 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.382721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.383491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.383914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.384358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.384842 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.385598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.386029 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.576175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:22.581031 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:22.584664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-825c0bf7-77c1-4176-8d8f-0dca7c264a5e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.213805 Jul 18 10:44:22.585259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 112/228] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:22 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:22.590656 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:22.591273 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:22.592572 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-31c336b8-50f9-4af3-911c-6562d3549226 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.218661 Jul 18 10:44:22.594319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 117/229] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:22 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:22.597666 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.598157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.599446 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:22.599892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:22.732415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:22.740308 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e34495bc-2804-4327-b06b-9e94ec30c66b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.153574 Jul 18 10:44:22.740880 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 113/230] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:22 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:23.069444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:23.070180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:23.076743 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.077195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.077959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.078389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.209120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:23.215652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-689e717e-d208-497b-97f2-e53c7ba34c21 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.150506 Jul 18 10:44:23.216223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 118/231] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:23 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:23.601449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:23.602057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:23.607973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.608421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.609229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.609630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.614400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:23.615521 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:23.621563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.622003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.622769 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.623205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.811512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:23.818672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:23.818991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1665570c-bc7e-458f-9d97-edfd3b117f73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1367 microversion: 2.1 time: 0.221430 Jul 18 10:44:23.819565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 114/232] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:23 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:23.824970 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:23.825656 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:23.826501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d9e25dec-cd71-4c4a-8c58-c6c6633f062c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.215806 Jul 18 10:44:23.827075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 119/233] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:23 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:23.832114 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.839526 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.839526 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:23.839526 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:23.969870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:23.977449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f41d74cf-b484-464c-9637-c942c4b17f4f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.156141 Jul 18 10:44:23.978015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 115/234] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:23 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:24.233370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:24.233908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:24.241492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.241844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:24.245041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.245041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:24.246781 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:24.388757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:24.396801 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e000147-8709-492c-b350-af83d9f98e94 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.167688 Jul 18 10:44:24.397368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 120/235] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:24 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:24.836309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:24.836867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:24.842988 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.843430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:24.844175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.844597 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:24.854753 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:24.855453 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:24.861620 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.862142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:24.862978 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:24.863416 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.041521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:25.045739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:25.049096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5352a685-6dee-4110-8766-f1dadc6dda39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1556 microversion: 2.1 time: 0.217349 Jul 18 10:44:25.049667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 116/236] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:24 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1556 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:25.054250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7882a39-d33b-4168-9b5a-c5ad922895e0 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.203433 Jul 18 10:44:25.054705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:25.055033 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 121/237] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:24 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:25.055307 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:25.061115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.063252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.063252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.063252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.074164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:25.074656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:25.080855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.081311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.082072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.082505 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.202473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3803a192-e0a8-4495-aa68-1faf25021661 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132007 Jul 18 10:44:25.209604 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 122/238] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:44:25 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:25.243648 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:25.251850 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f269ec40-b895-40e9-ba46-9ed11e8f436c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.201200 Jul 18 10:44:25.252613 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 117/239] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:25 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:25.416143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:25.417567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:25.425044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.425789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.426900 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:25.428811 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:25.562438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:25.570908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-906e6f26-f2cd-4e2a-a5d8-cbac4a6d2e53 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1554 microversion: 2.1 time: 0.160502 Jul 18 10:44:25.571477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 123/240] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:25 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:26.079592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:26.096158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:26.096158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.096158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.096158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.096540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.229758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:26.237874 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dafc6740-5bad-4f7f-afef-1e63cf165da1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.162258 Jul 18 10:44:26.238453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 118/241] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:26 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:26.269049 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:26.269173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:26.276108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.281167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.281167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.281167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.412525 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:26.419599 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d0cabc0a-e456-4225-93e2-045c3f77dd1e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.155239 Jul 18 10:44:26.420211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 124/242] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:26 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:26.587289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:26.587892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:26.594041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.594486 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.595242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.595672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.659030 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:26.668037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07b11e16-383c-46ce-9b08-d318bfc41ce8 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1512 microversion: 2.1 time: 0.084539 Jul 18 10:44:26.668665 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 119/243] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:26 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:26.694794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-06ddbf46-82bc-4786-b1f1-a9cd2843e14e req-48c85130-4613-4d75-a7d4-03625af3bae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7026e56b-bb11-4309-9c6d-5031da4ca1d7", "name": "network-vif-deleted", "tag": "e9762284-09aa-4dcd-a41a-ceeaf921c98e"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:26.702912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-06ddbf46-82bc-4786-b1f1-a9cd2843e14e req-48c85130-4613-4d75-a7d4-03625af3bae8 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:26.703351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-06ddbf46-82bc-4786-b1f1-a9cd2843e14e req-48c85130-4613-4d75-a7d4-03625af3bae8 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:26.716975 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-06ddbf46-82bc-4786-b1f1-a9cd2843e14e req-48c85130-4613-4d75-a7d4-03625af3bae8 service nova] Creating event network-vif-deleted:e9762284-09aa-4dcd-a41a-ceeaf921c98e for instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 on hv-cinder-84617 Jul 18 10:44:26.722703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-06ddbf46-82bc-4786-b1f1-a9cd2843e14e req-48c85130-4613-4d75-a7d4-03625af3bae8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032396 Jul 18 10:44:26.723496 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 125/244] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:27.256036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:27.256815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:27.263423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.264072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.264895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.265325 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.400596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:27.407907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-112d1193-c4bf-4842-8d41-5b0ad3cccb82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.156765 Jul 18 10:44:27.408525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 120/245] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:27 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:27.436810 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:27.437635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:27.445229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.445669 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.446527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.447004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.580429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:27.588477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3e5a0719-3e8d-4a3c-acca-c456b3e9e68c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.155929 Jul 18 10:44:27.589367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 126/246] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:27 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:27.686438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:27.687196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:27.693197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.693645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.694475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:27.694938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:27.758427 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:27.766786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-64b72929-a5ce-43d0-926c-7e77f599d87b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1512 microversion: 2.1 time: 0.084515 Jul 18 10:44:27.767550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 121/247] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:27 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:28.424324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:28.424964 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:28.430916 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.433536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.433536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.433536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.564022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:28.569974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4b66807e-5b7a-4ab6-91d7-6c1d866f6b4e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.149470 Jul 18 10:44:28.570590 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 127/248] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:28 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:28.606059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:28.606689 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:28.612805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.613252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.614004 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.614433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.744081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-6b60a575-59c2-458e-a5bd-512bc25148e1 req-9305917b-ed60-4e7c-b6d8-cbfc2e4b84a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6158dc6a-973a-4cad-b71a-e607de559786", "tag": "5cdc2dfe-53a8-4444-ba69-41d081778649"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:28.752449 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-6b60a575-59c2-458e-a5bd-512bc25148e1 req-9305917b-ed60-4e7c-b6d8-cbfc2e4b84a6 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.752928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-6b60a575-59c2-458e-a5bd-512bc25148e1 req-9305917b-ed60-4e7c-b6d8-cbfc2e4b84a6 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.757889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:28.765698 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-6b60a575-59c2-458e-a5bd-512bc25148e1 req-9305917b-ed60-4e7c-b6d8-cbfc2e4b84a6 service nova] Creating event network-changed:5cdc2dfe-53a8-4444-ba69-41d081778649 for instance 6158dc6a-973a-4cad-b71a-e607de559786 on hv-cinder-84617 Jul 18 10:44:28.770451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f4cc27ce-83ab-46f2-a0a2-69c308250c48 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.164891 Jul 18 10:44:28.770451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 122/249] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:28 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:28.770732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-6b60a575-59c2-458e-a5bd-512bc25148e1 req-9305917b-ed60-4e7c-b6d8-cbfc2e4b84a6 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030827 Jul 18 10:44:28.771493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 128/250] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:28.783159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:28.783763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:28.790000 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.790448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.791231 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:28.791662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:28.859612 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:28.868256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-75ab9030-6b10-4cbd-8583-4a384b9db7ed tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1346 microversion: 2.1 time: 0.088847 Jul 18 10:44:28.868842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 123/251] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:28 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:29.588307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:29.588969 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:29.595284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.595734 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.596503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.596973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.734874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:29.740075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-55be032a-9608-4e37-b7ca-0a844cd4fda3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.157143 Jul 18 10:44:29.740863 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 129/252] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:29 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:29.783985 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:29.784663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:29.791222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.791667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.792434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.792886 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.886641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:29.887319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:29.895500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.895500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.895500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:29.895823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:29.927256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:29.939380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f92b6675-2fc5-4f97-9dbb-ef41d870cdc5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.159055 Jul 18 10:44:29.940780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 124/253] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:29 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:29.973127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:29.982288 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-11fb64b9-06e2-4340-8bd0-584b2c2e0cf6 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1346 microversion: 2.1 time: 0.099898 Jul 18 10:44:29.982844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 130/254] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:29 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:30.759105 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:30.759824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:30.764200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:30.767726 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:30.768230 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:30.768962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:30.770178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:30.794074 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:30.920646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:30.928550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-de5fa485-b3e7-4260-aece-0835aee7f2a6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.174162 Jul 18 10:44:30.929373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 125/255] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:30 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:30.957246 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:30.957857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:30.965020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:30.965478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:30.966263 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:30.966701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:31.004407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:31.005434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:31.012387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:31.014989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:31.014989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:31.014989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:31.048428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:31.048605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:31.049081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lazy-loading 'fault' on Instance uuid 7026e56b-bb11-4309-9c6d-5031da4ca1d7 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:44:31.113897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb0ed48dd034be0ad63373e4a151cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5f3aeaf69e147fc9c2e04723cea0fd2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:31.123788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a77ef81-f4af-4f92-954d-638a8d2cb828 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 200 len: 1351 microversion: 2.1 time: 0.123078 Jul 18 10:44:31.124371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 126/256] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:30 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 1351 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:31.141051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:31.148996 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2956c238-8036-4377-a75b-8d7848c15680 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.195601 Jul 18 10:44:31.150051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 131/257] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:30 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:31.948821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:31.949545 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:31.956351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:31.956885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:31.957654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:31.958094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.093483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:32.101019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0b27ae7b-7ca0-4a5c-a8eb-1d6748bd2feb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.156993 Jul 18 10:44:32.101612 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 127/258] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:31 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:32.141300 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:32.141913 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:32.148113 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.148813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.150089 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.150714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.164547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] HTTP exception thrown: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.168132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:32.168847 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Request method failure captured: Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 HTTP/1.1 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGUtwQ_RM0AaTHoDr5jd69TruJLqMCQtKQBZm_ln4SxzsOC94embExifhqOuxXJ0EcqT4OkE6m0HWcCg8Fe8sEWb2Yi3fA_6GiqRO_UjqDgYvgUx7Hmm0nLWDiJwHFKfpUZLH3UGuFI22soI5rg6POoVjsr7SOfQnW7oSS5crMsck Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:44:32.170312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}] Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 8eb0ed48dd034be0ad63373e4a151cd9 Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.171520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '7026e56b-bb11-4309-9c6d-5031da4ca1d7'} Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:32.172306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.174121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.175354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Returning 404 to user: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:32.175354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-294ed5bb-090c-4ec5-a39e-6b637c571492 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 404 len: 111 microversion: 2.1 time: 0.034289 Jul 18 10:44:32.175354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 132/259] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:32 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:32.182863 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.183409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.184427 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.184955 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.292120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:32.293152 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:32.300379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.301742 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.301842 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:32.302316 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:32.315930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] HTTP exception thrown: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Request method failure captured: Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7/os-volume_attachments HTTP/1.1 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGUtwQ_RM0AaTHoDr5jd69TruJLqMCQtKQBZm_ln4SxzsOC94embExifhqOuxXJ0EcqT4OkE6m0HWcCg8Fe8sEWb2Yi3fA_6GiqRO_UjqDgYvgUx7Hmm0nLWDiJwHFKfpUZLH3UGuFI22soI5rg6POoVjsr7SOfQnW7oSS5crMsck Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:44:32.318065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}] Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 8eb0ed48dd034be0ad63373e4a151cd9 Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.319262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'server_id': '7026e56b-bb11-4309-9c6d-5031da4ca1d7'} Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:32.319947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:32.324961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:32.326319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Returning 404 to user: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:32.326319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9626a02b-6890-40ef-a9bb-6b9a08240772 tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032347 Jul 18 10:44:32.326319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 133/260] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:44:32 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:44:32.341113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:32.353301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e21c7aae-fd00-485e-b4b8-df2d6851ca02 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.189517 Jul 18 10:44:32.365008 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 128/261] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:32 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:33.118929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:33.119534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:33.125658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:33.126127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:33.132895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:33.132895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:33.260736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:33.268514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8c9c1028-b975-43a5-b1ed-766673c97a82 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.153512 Jul 18 10:44:33.269022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 134/262] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:33 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:33.370991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:33.371690 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:33.378416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:33.378859 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:33.379631 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:33.380060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:33.515072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:33.523548 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a76f499f-ff92-4a27-ada2-40a68db192c2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.156633 Jul 18 10:44:33.524830 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 129/263] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:33 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:34.286070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:34.286701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:34.293919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:34.294363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:34.295117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:34.295546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:34.424517 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:34.431814 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1b0d8629-090b-4d9d-9ae2-4dc2c230230f tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.149575 Jul 18 10:44:34.433179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 135/264] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:34 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:34.540476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:34.541142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:34.547771 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:34.548216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:34.548994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:34.549426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:34.680888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:34.688778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce9d6d74-d93d-4784-9282-54adaff0092a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.152156 Jul 18 10:44:34.689350 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 130/265] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:34 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:35.449721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:35.450969 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:35.460307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.460307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.460307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.460307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.599587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:35.607835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7984d51a-41ba-4ad5-9fd4-b87bd5fc9717 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.162215 Jul 18 10:44:35.608396 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 136/266] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:35 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:35.707431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:35.708143 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:35.714970 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.715409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.716178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.716609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.795338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:35.796048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:35.803285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.803285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.804109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.804615 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.859140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:35.875861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02b82fb3-0df7-47e0-9c22-05a366d88a37 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.172080 Jul 18 10:44:35.876266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 131/267] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:35 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:35.957340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] HTTP exception thrown: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Request method failure captured: Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 HTTP/1.1 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGUtwQ_RM0AaTHoDr5jd69TruJLqMCQtKQBZm_ln4SxzsOC94embExifhqOuxXJ0EcqT4OkE6m0HWcCg8Fe8sEWb2Yi3fA_6GiqRO_UjqDgYvgUx7Hmm0nLWDiJwHFKfpUZLH3UGuFI22soI5rg6POoVjsr7SOfQnW7oSS5crMsck Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:44:35.958882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}] Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 8eb0ed48dd034be0ad63373e4a151cd9 Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.960072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '7026e56b-bb11-4309-9c6d-5031da4ca1d7'} Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:35.960749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.961872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.963004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Returning 404 to user: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:35.963004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dcdf58a1-71eb-4647-b63f-6febc4eeec5b tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 404 len: 111 microversion: 2.1 time: 0.169641 Jul 18 10:44:35.963004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 137/268] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:44:35 2022] DELETE /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:44:35.969293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:35.969962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] [instance: 7026e56b-bb11-4309-9c6d-5031da4ca1d7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:35.976109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.977156 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.977581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:35.978076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:35.992071 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] HTTP exception thrown: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Request method failure captured: Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 HTTP/1.1 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGUtwQ_RM0AaTHoDr5jd69TruJLqMCQtKQBZm_ln4SxzsOC94embExifhqOuxXJ0EcqT4OkE6m0HWcCg8Fe8sEWb2Yi3fA_6GiqRO_UjqDgYvgUx7Hmm0nLWDiJwHFKfpUZLH3UGuFI22soI5rg6POoVjsr7SOfQnW7oSS5crMsck Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:44:35.997356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f5f3aeaf69e147fc9c2e04723cea0fd2"}]}] Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f5f3aeaf69e147fc9c2e04723cea0fd2 Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-DeleteServersTestJSON-1234503138 Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 8eb0ed48dd034be0ad63373e4a151cd9 Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-DeleteServersTestJSON-1234503138-project Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.998769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '7026e56b-bb11-4309-9c6d-5031da4ca1d7'} Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:35.999488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. Jul 18 10:44:36.000780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:36.006940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] Returning 404 to user: Instance 7026e56b-bb11-4309-9c6d-5031da4ca1d7 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:36.006940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1d11aa2a-e276-4755-a7a9-5f1a4d20924d tempest-DeleteServersTestJSON-1234503138 tempest-DeleteServersTestJSON-1234503138-project] 10.222.0.47 "GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7" status: 404 len: 111 microversion: 2.1 time: 0.033429 Jul 18 10:44:36.006940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 132/269] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:35 2022] GET /compute/v2.1/servers/7026e56b-bb11-4309-9c6d-5031da4ca1d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:36.624883 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:36.625426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:36.633123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:36.633565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:36.634329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:36.634796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:36.908337 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:36.909478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:36.910358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:36.916216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d243a51-cc1b-45cb-8685-8dec2d1f44e2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.295267 Jul 18 10:44:36.916973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 138/270] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:36 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:36.917106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:36.917558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:36.918425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:36.918949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:37.102356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-b4f4cf14-7679-4a81-b19a-17bb71633029 req-1d12e239-2c57-4bb3-839e-d2b9da5cb51b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec0babc-bd9d-46f7-9045-011b4cbb5356", "name": "network-vif-plugged", "status": "completed", "tag": "81ec280a-fd52-4eaf-8791-4aadd2f2c0bf"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:37.115925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b4f4cf14-7679-4a81-b19a-17bb71633029 req-1d12e239-2c57-4bb3-839e-d2b9da5cb51b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:37.115925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b4f4cf14-7679-4a81-b19a-17bb71633029 req-1d12e239-2c57-4bb3-839e-d2b9da5cb51b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:37.129287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-b4f4cf14-7679-4a81-b19a-17bb71633029 req-1d12e239-2c57-4bb3-839e-d2b9da5cb51b service nova] Creating event network-vif-plugged:81ec280a-fd52-4eaf-8791-4aadd2f2c0bf for instance dec0babc-bd9d-46f7-9045-011b4cbb5356 on hv-cinder-84617 Jul 18 10:44:37.134511 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-b4f4cf14-7679-4a81-b19a-17bb71633029 req-1d12e239-2c57-4bb3-839e-d2b9da5cb51b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036299 Jul 18 10:44:37.135345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 139/271] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:37.141357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:37.156426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-907a5dba-66c3-4749-9624-fea34b2ff675 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.250827 Jul 18 10:44:37.157029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 133/272] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:36 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:37.934359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:37.935051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:37.942481 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:37.942973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:37.943691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:37.944118 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:38.140420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:38.149823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4078c9a0-4f59-4516-bebc-3bf74114a6ca tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.220305 Jul 18 10:44:38.150618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 140/273] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:37 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:38.173943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:38.175145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:38.182005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:38.182792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:38.183680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:38.184203 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:38.335004 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:38.343877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eed06445-de33-4c4c-bffe-f0ea3de0e39a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.173692 Jul 18 10:44:38.344524 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 134/274] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:38 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:39.167825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:39.168599 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:39.175369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:39.175823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:39.176592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:39.177077 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:39.181166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:39.334885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:39.342849 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-afeada97-7e6c-419e-8db1-79bd92e388d3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1318 microversion: 2.1 time: 0.179152 Jul 18 10:44:39.343734 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 141/275] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:39 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:39.361143 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:39.361813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:39.367994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:39.368443 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:39.369973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:39.370359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:39.509345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:39.518321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7c1f536f-ff6f-4123-8d04-57fb891adef8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.160987 Jul 18 10:44:39.518903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 135/276] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:39 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:40.360304 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:40.361146 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:40.368100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:40.368545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:40.370155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:40.370600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:40.537348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:40.538555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:40.546921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:40.550856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:40.552741 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:40.553367 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:40.586822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:40.597747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-415788e5-575d-4716-bb43-9fa5664727d6 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1507 microversion: 2.1 time: 0.241479 Jul 18 10:44:40.609371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 142/277] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:40 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1507 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:40.856007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:40.865015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-72b14ef5-9b4c-4c27-a497-6cd71073cceb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.331446 Jul 18 10:44:40.869523 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 136/278] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:40 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:41.883948 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:41.884565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:41.891466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:41.891920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:41.892787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:41.893227 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:42.033854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:42.041808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c5a669c9-0637-4c78-9b79-799f6afb925e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.161125 Jul 18 10:44:42.042465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 143/279] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:41 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:43.057829 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:43.058528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:43.065142 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:43.065942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:43.066717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:43.067152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:43.228836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:43.239062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e62c240b-e588-492f-80e9-954fe0af673f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1521 microversion: 2.1 time: 0.185063 Jul 18 10:44:43.247625 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 137/280] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:43 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:43.723046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5839e48a-459d-4331-ae9f-ae4409c4b4db tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Action: 'create', calling method: .version_select at 0x7f5f0aad2310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-66394816"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:44.255551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:44.256170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:44.262335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:44.262690 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:44.263455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:44.263889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:44.397033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:44.405144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-997fc487-ca66-492f-8d67-62d688638093 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1501 microversion: 2.1 time: 0.153492 Jul 18 10:44:44.405816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 138/281] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:44 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:44.422369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:44.423201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:44.429869 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:44.430548 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:44.431532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:44.432170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:44.565418 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:44.572876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-11f1f3a1-aa73-4521-b460-c11bc3faf72a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1516 microversion: 2.1 time: 0.154841 Jul 18 10:44:44.573439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 139/282] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:44 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:44:44.652864 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5839e48a-459d-4331-ae9f-ae4409c4b4db tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 1.061465 Jul 18 10:44:44.653485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 144/283] 10.222.0.47 () {60 vars in 1154 bytes} [Mon Jul 18 10:44:43 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 1063 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 10:44:44.664762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e38ec2af-1593-4f29-bfe5-3deb93e3bd70 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a799280>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:44.722722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e38ec2af-1593-4f29-bfe5-3deb93e3bd70 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 200 len: 343 microversion: 2.1 time: 0.061803 Jul 18 10:44:44.723302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 140/284] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:44:44 2022] GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 343 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:45.735933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2baa066b-11cb-42a4-a170-f4039aa8c90d tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a8301f0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:46.307662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2baa066b-11cb-42a4-a170-f4039aa8c90d tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 200 len: 344 microversion: 2.1 time: 0.575755 Jul 18 10:44:46.308320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 145/285] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:44:45 2022] GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 344 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:46.320939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-35cf6827-8b63-4c42-a05b-2f68b2b3e2e9 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Action: 'create', calling method: .version_select at 0x7f5f0aa9d9d0>, body: {"snapshot": {"volume_id": "1b0b7773-0b14-4459-9a3e-9ddef6a24e05", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1952855891"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:47.046221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-35cf6827-8b63-4c42-a05b-2f68b2b3e2e9 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.729037 Jul 18 10:44:47.046912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 141/286] 10.222.0.47 () {60 vars in 1161 bytes} [Mon Jul 18 10:44:46 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:47.061814 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-44d3167e-ed15-4b71-998d-139abafef6fa tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a9c14c0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:47.104390 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:44:47.105418 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:47.113106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-44d3167e-ed15-4b71-998d-139abafef6fa tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.055290 Jul 18 10:44:47.113667 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 146/287] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:47 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:47.113867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:47.114567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:47.115450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:47.115889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:47.123782 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c23f9b81-b48e-462e-878e-e8f8725640a0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0aad20d0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:47.163369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c23f9b81-b48e-462e-878e-e8f8725640a0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.043722 Jul 18 10:44:47.163933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 147/288] 10.222.0.47 () {58 vars in 1139 bytes} [Mon Jul 18 10:44:47 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:47.174932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4dc20969-ca84-4418-a20f-cb272136f025 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0aa4d4c0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:47.207218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4dc20969-ca84-4418-a20f-cb272136f025 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.036264 Jul 18 10:44:47.207974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 148/289] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:47 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:47.282366 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'flavor' on Instance uuid 177dc191-0770-4ba1-9219-e38d05c4091d {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:44:47.457154 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:47.696790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7b0a09b7-1949-4397-b12d-003c27324d5b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/action" status: 200 len: 32 microversion: 2.1 time: 0.596215 Jul 18 10:44:47.697380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 142/290] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:44:47 2022] POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/action => generated 32 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:44:47.706763 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:47.707363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:47.713653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:47.714099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:47.714855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:47.715283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:47.867350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:47.875530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-39b33c0d-3088-4b82-8758-b1ebc39f8cf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.172783 Jul 18 10:44:47.876106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 149/291] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:47 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:48.220192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5ae358ce-0e57-4715-8b91-39e816340d8a tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a89d3a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:48.250030 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5ae358ce-0e57-4715-8b91-39e816340d8a tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.034439 Jul 18 10:44:48.250949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 143/292] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:48 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:48.893233 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:48.893851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:48.900415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:48.900918 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:48.901683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:48.902120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:49.031296 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:49.038652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-947a684d-b10d-4560-b56d-797abf6b5007 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.150182 Jul 18 10:44:49.039208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 150/293] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:48 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:49.262392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-245fa1c7-dba4-4057-8057-bea09c19b5c2 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a9189d0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:49.292329 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-245fa1c7-dba4-4057-8057-bea09c19b5c2 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.034193 Jul 18 10:44:49.292931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 144/294] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:49 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:50.055586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:50.056196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:50.062629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:50.063073 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:50.063871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:50.064303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:50.199719 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:50.208999 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-03b92681-32b0-460b-a4c0-f70bdaaf961d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.157284 Jul 18 10:44:50.209576 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 151/295] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:50 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:50.304876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-270122d2-b2f0-4b98-bbdd-0460150dcbb1 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a9185e0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:50.337058 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-270122d2-b2f0-4b98-bbdd-0460150dcbb1 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.036111 Jul 18 10:44:50.337686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 145/296] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:50 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:51.226160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:51.226672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:51.229106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=64 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:44:51.234939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:51.235466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:51.236266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:51.236729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:51.349026 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-020123ff-c19e-4c3a-9cd7-0bdb7989b16b tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a8ec1f0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:51.371156 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:51.379211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b8945e89-33cf-4cbd-aeb1-0e12d95ab93f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.156936 Jul 18 10:44:51.379814 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 152/297] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:51 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:51.381086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-020123ff-c19e-4c3a-9cd7-0bdb7989b16b tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 288 microversion: 2.1 time: 0.035778 Jul 18 10:44:51.381652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 146/298] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:51 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 288 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:51.392455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-160ec7e9-3863-4458-8fac-d5c2c853936c tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a830430>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:51.547623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-160ec7e9-3863-4458-8fac-d5c2c853936c tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "DELETE /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 202 len: 0 microversion: 2.1 time: 0.159413 Jul 18 10:44:51.548197 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 153/299] 10.222.0.47 () {58 vars in 1253 bytes} [Mon Jul 18 10:44:51 2022] DELETE /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:44:51.556986 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-87d2732f-1e0e-4171-855d-19954b2055c3 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a8c2ca0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:51.598627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-87d2732f-1e0e-4171-855d-19954b2055c3 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 200 len: 287 microversion: 2.1 time: 0.045618 Jul 18 10:44:51.599192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 147/300] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:51 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 287 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:44:52.397458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:52.397991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:52.404115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:52.404663 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:52.405453 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:52.405885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:52.543977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:52.552640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c385b340-ee46-49f0-aa1e-f091fa66e2d4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.159605 Jul 18 10:44:52.553303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 154/301] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:52 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:52.610560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d89e69d-f407-4272-8957-7c8e877ebd8f tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a790820>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:52.668779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-2d89e69d-f407-4272-8957-7c8e877ebd8f tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] HTTP exception thrown: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d89e69d-f407-4272-8957-7c8e877ebd8f tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Request method failure captured: Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af HTTP/1.1 Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tmbn9RPLzj8PjkLsdq-aWMMOC4fQeUstajs_21LH_VuvtGc0zExjK7OBFICuchWkg6Fw5IVIsp-Q2ZNHLIlSaRPcA0N9YoxIPEcxlkcdvhAOyQAyHFqgIGzYmHGn4VSDRQ_jvRzn1Kl2v504tyMQuvsGuUpD4UmPIIdexRvnVtOzxM Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:44:52.671227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73bae9dc8c5b44a79d46bf667f6031da"}]}] Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 2d5c797091db4d808c3d876f6f64d081 Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '00e21047-0299-41d2-8f59-c4c8b10ea0af'} Jul 18 10:44:52.672756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. (HTTP 404) (Request-ID: req-dd987739-9b5d-4749-bcf5-466d8e4ef3ff) Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.673673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:52.674877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 10:44:52.676206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d89e69d-f407-4272-8957-7c8e877ebd8f tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Returning 404 to user: Snapshot 00e21047-0299-41d2-8f59-c4c8b10ea0af could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2d89e69d-f407-4272-8957-7c8e877ebd8f tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af" status: 404 len: 111 microversion: 2.1 time: 0.066072 Jul 18 10:44:52.677647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 148/302] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:44:52 2022] GET /compute/v2.1/os-snapshots/00e21047-0299-41d2-8f59-c4c8b10ea0af => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:52.681333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c725c5f1-5c3a-4eae-9815-2b7069027ac3 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0aaa50d0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:52.955475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c725c5f1-5c3a-4eae-9815-2b7069027ac3 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 202 len: 0 microversion: 2.1 time: 0.277657 Jul 18 10:44:52.956032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 155/303] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:44:52 2022] DELETE /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:44:52.964160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d54e40c8-df8b-473b-ae67-184dd0bd54b7 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a8ec3a0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:53.024480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d54e40c8-df8b-473b-ae67-184dd0bd54b7 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 200 len: 343 microversion: 2.1 time: 0.064056 Jul 18 10:44:53.025072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 149/304] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:44:52 2022] GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 343 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:44:53.570561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:53.575142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:53.577873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:53.578330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:53.579152 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:53.579595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:53.712981 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:53.722137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3cfa23d7-a371-4c0b-9286-30e5958edde4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.155923 Jul 18 10:44:53.722777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 156/305] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:53 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:54.039947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d063e7e6-7a97-4f08-8b38-02d5c1da7aa0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a89d1f0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:54.069781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-d063e7e6-7a97-4f08-8b38-02d5c1da7aa0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] HTTP exception thrown: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d063e7e6-7a97-4f08-8b38-02d5c1da7aa0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Request method failure captured: Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 HTTP/1.1 Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tmbn9RPLzj8PjkLsdq-aWMMOC4fQeUstajs_21LH_VuvtGc0zExjK7OBFICuchWkg6Fw5IVIsp-Q2ZNHLIlSaRPcA0N9YoxIPEcxlkcdvhAOyQAyHFqgIGzYmHGn4VSDRQ_jvRzn1Kl2v504tyMQuvsGuUpD4UmPIIdexRvnVtOzxM Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:44:54.071543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73bae9dc8c5b44a79d46bf667f6031da"}]}] Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 2d5c797091db4d808c3d876f6f64d081 Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '1b0b7773-0b14-4459-9a3e-9ddef6a24e05'} Jul 18 10:44:54.073048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. (HTTP 404) (Request-ID: req-095d2433-f8c7-46d1-8e3e-51c1536c7513) Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.073887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:54.075160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:44:54.086410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d063e7e6-7a97-4f08-8b38-02d5c1da7aa0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Returning 404 to user: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d063e7e6-7a97-4f08-8b38-02d5c1da7aa0 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 404 len: 109 microversion: 2.1 time: 0.037034 Jul 18 10:44:54.087950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 150/306] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:44:54 2022] GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:54.090371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8f133f52-a5b7-443a-9777-9887d92cc696 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a846040>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:54.121125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-8f133f52-a5b7-443a-9777-9887d92cc696 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] HTTP exception thrown: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8f133f52-a5b7-443a-9777-9887d92cc696 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Request method failure captured: Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 HTTP/1.1 Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1Tmbn9RPLzj8PjkLsdq-aWMMOC4fQeUstajs_21LH_VuvtGc0zExjK7OBFICuchWkg6Fw5IVIsp-Q2ZNHLIlSaRPcA0N9YoxIPEcxlkcdvhAOyQAyHFqgIGzYmHGn4VSDRQ_jvRzn1Kl2v504tyMQuvsGuUpD4UmPIIdexRvnVtOzxM Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:44:54.125094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73bae9dc8c5b44a79d46bf667f6031da"}]}] Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 2d5c797091db4d808c3d876f6f64d081 Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '1b0b7773-0b14-4459-9a3e-9ddef6a24e05'} Jul 18 10:44:54.134264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. (HTTP 404) (Request-ID: req-6a4e6683-ef19-40d0-ad38-fcb7778813c6) Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.135482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 10:44:54.136955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 10:44:54.139179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8f133f52-a5b7-443a-9777-9887d92cc696 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Returning 404 to user: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8f133f52-a5b7-443a-9777-9887d92cc696 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "DELETE /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 404 len: 109 microversion: 2.1 time: 0.042452 Jul 18 10:44:54.143739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 157/307] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:44:54 2022] DELETE /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:54.154817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c1ca7f1b-db71-4793-9b36-12e633d03813 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Calling method '.version_select at 0x7f5f0a8ec280>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-c1ca7f1b-db71-4793-9b36-12e633d03813 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] HTTP exception thrown: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c1ca7f1b-db71-4793-9b36-12e633d03813 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Request method failure captured: Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 HTTP/1.1 Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tmbn9RPLzj8PjkLsdq-aWMMOC4fQeUstajs_21LH_VuvtGc0zExjK7OBFICuchWkg6Fw5IVIsp-Q2ZNHLIlSaRPcA0N9YoxIPEcxlkcdvhAOyQAyHFqgIGzYmHGn4VSDRQ_jvRzn1Kl2v504tyMQuvsGuUpD4UmPIIdexRvnVtOzxM Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:44:54.189322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/73bae9dc8c5b44a79d46bf667f6031da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/73bae9dc8c5b44a79d46bf667f6031da"}]}] Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 73bae9dc8c5b44a79d46bf667f6031da Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-967224026 Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 2d5c797091db4d808c3d876f6f64d081 Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-VolumesSnapshotsTestJSON-967224026-project Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '1b0b7773-0b14-4459-9a3e-9ddef6a24e05'} Jul 18 10:44:54.190763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. (HTTP 404) (Request-ID: req-dbaffb6d-de92-45e3-a2dd-75492e47cfdb) Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.191611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 10:44:54.192870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 10:44:54.194047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c1ca7f1b-db71-4793-9b36-12e633d03813 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] Returning 404 to user: Volume 1b0b7773-0b14-4459-9a3e-9ddef6a24e05 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c1ca7f1b-db71-4793-9b36-12e633d03813 tempest-VolumesSnapshotsTestJSON-967224026 tempest-VolumesSnapshotsTestJSON-967224026-project] 10.222.0.47 "GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05" status: 404 len: 109 microversion: 2.1 time: 0.042696 Jul 18 10:44:54.195611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 151/308] 10.222.0.47 () {58 vars in 1244 bytes} [Mon Jul 18 10:44:54 2022] GET /compute/v2.1/os-volumes/1b0b7773-0b14-4459-9a3e-9ddef6a24e05 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:44:54.739767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:54.740508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:54.749221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:54.749700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:54.750658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:54.751218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:54.904707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:54.917477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a6d45638-af8d-42fd-8f24-908723f3088f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.182028 Jul 18 10:44:54.927946 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 158/309] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:54 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:55.935434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:55.942044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:55.949326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:55.950087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:55.952127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:55.952822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:56.113801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:56.122337 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b2ff6c10-5399-4c6e-bc3a-1e4d62c7f3c9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.191084 Jul 18 10:44:56.123552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 152/310] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:55 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:57.139953 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:57.140600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:57.147516 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:57.147965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:57.148750 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:57.149214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:57.332355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:57.341090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6f54ef2a-2d6d-4796-8246-f3e4e794506a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.204861 Jul 18 10:44:57.341870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 159/311] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:57 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:58.359353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:58.360102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:58.368205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:58.368205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:58.368205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:58.368509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:58.518818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:58.526668 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d9097324-c5f9-4a50-a153-f085e9fb5ffa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.171567 Jul 18 10:44:58.527295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 153/312] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:58 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:44:59.550742 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:44:59.551374 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:44:59.557619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:59.558075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:59.558839 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:44:59.559275 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:44:59.691949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:44:59.699943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5da619dd-db6c-40e6-ae84-8872d44c23a8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.153320 Jul 18 10:44:59.701125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 160/313] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:44:59 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:00.722239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:00.729161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:00.730589 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:00.731108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:00.731935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:00.732577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:00.871429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:00.879371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-66a9c45a-bbb3-4bc3-9c96-fad1454663dd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.162457 Jul 18 10:45:00.879931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 154/314] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:00 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:01.896855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:01.897473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:01.905171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:01.908175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:01.909030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:01.909469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:02.045365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:02.052860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-230fce9e-d23b-438a-b003-48de1a0ec351 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.159896 Jul 18 10:45:02.053415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 161/315] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:01 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:03.071373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:03.071991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:03.073975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=39 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:03.080041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:03.081429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:03.081429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:03.081744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:03.291899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:03.300884 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3cd1dee5-6dc0-45a2-b4c6-25a33df86a83 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.233363 Jul 18 10:45:03.307016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 155/316] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:03 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:04.318350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:04.318958 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:04.326193 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:04.326847 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:04.327646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:04.328080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:04.461784 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:04.471346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7bcfe19b-e543-441b-a6a5-1129ce40efec tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.156830 Jul 18 10:45:04.471916 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 162/317] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:04 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:05.489665 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:05.490363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:05.497472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:05.497971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:05.498747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:05.499182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:05.647185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:05.647718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91055de4-38af-43e0-a0dd-c227cf247064 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.162778 Jul 18 10:45:05.660614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 156/318] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:05 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:06.667471 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:06.669413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:06.676259 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:06.676868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:06.677697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:06.678111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:06.817564 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:06.825980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-63c5f9ee-731e-4bca-a51b-7a8c6ece386f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.162221 Jul 18 10:45:06.826922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 163/319] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:06 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:07.843229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:07.843842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:07.850056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:07.850503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:07.851263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:07.851696 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:07.983989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:07.992819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5dd1c615-d3bf-4542-a5dc-0c002b3c2081 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.153570 Jul 18 10:45:07.993333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 157/320] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:07 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:08.126900 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edfa22e-4709-4119-8e6f-d972e9795e50", "device": "/dev/sdb"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:08.128838 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:08.135436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:08.136388 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:08.137189 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:08.137661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:09.010428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:09.011054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:09.017460 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:09.017899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:09.018655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:09.019082 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:09.156823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:09.164180 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-204c48db-6458-4978-844f-8c1ab586c99c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.157768 Jul 18 10:45:09.164760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 158/321] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:09 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:09.484643 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:09.679801 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e0231425-4f2c-4473-8e6b-64b045baf8fb tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "POST /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.557120 Jul 18 10:45:09.680420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 164/322] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:45:08 2022] POST /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356/os-volume_attachments => generated 194 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:10.181551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:10.182156 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:10.189609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:10.190052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:10.190811 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:10.191239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:10.329072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:10.336931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-96b5b245-7a46-4f53-ab32-6c25cf49c265 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.159149 Jul 18 10:45:10.337490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 159/323] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:10 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:11.355869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:11.356571 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:11.363922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.364377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.365214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.365653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.503453 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:11.510947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-aa9c1d8e-5889-4618-9cf0-96fe75b4d827 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1502 microversion: 2.1 time: 0.160530 Jul 18 10:45:11.511510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 165/324] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:11 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:11.528285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a3c679c-1f02-4e44-bf6c-c2958a478be4"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:11.529556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:11.535661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.536109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.536906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.537346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.560609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] HTTP exception thrown: Cannot 'attach_volume' instance 177dc191-0770-4ba1-9219-e38d05c4091d while it is in vm_state rescued Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Request method failure captured: Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/os-volume_attachments HTTP/1.1 Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 74 Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tk9SiiE0L5kH31TkXu9czHK7m_0icXDrH3ei5XbjQT4yzoh83KjKtdbHUtGLj8M8pL8mpHaBYYf5aN-h9yQ-JBWbZLk_qhFC__atD8Zi5dyMScdrMnYITxi1tT_Ee_r88TDSdM8Ctqdr64zb60A56tdFGsoNGhviR289oUogDo5eaE Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:45:11.562936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b0e325a6638442b9a2a929a6525f7c2e"}]}] Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: b86d6011a3f04ad0bf5b8be696c789f2 Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {"volumeAttachment": {"volumeId": "5a3c679c-1f02-4e44-bf6c-c2958a478be4"}} Jul 18 10:45:11.564167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Cannot 'attach_volume' instance 177dc191-0770-4ba1-9219-e38d05c4091d while it is in vm_state rescued Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'server_id': '177dc191-0770-4ba1-9219-e38d05c4091d', 'body': {'volumeAttachment': {'volumeId': '5a3c679c-1f02-4e44-bf6c-c2958a478be4'}}} Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 177dc191-0770-4ba1-9219-e38d05c4091d in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:45:11.565219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 177dc191-0770-4ba1-9219-e38d05c4091d while it is in vm_state rescued Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:45:11.566561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 177dc191-0770-4ba1-9219-e38d05c4091d while it is in vm_state rescued Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Returning 409 to user: Cannot 'attach_volume' instance 177dc191-0770-4ba1-9219-e38d05c4091d while it is in vm_state rescued {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4cf9a708-9953-428f-88fd-ead55bd5a062 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040112 Jul 18 10:45:11.567868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 160/325] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:45:11 2022] POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:45:11.578068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:11.578613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:11.585261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.585952 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.586733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.587176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.866502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ab9f5adc-3cbf-4f6c-b4f7-3ee6e12b7eee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/action" status: 202 len: 0 microversion: 2.1 time: 0.292061 Jul 18 10:45:11.867894 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 166/326] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:45:11 2022] POST /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d/action => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:45:11.876287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:11.877033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:11.884795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.886135 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:11.886557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:11.886985 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:12.031822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:12.039344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a3ebbc0d-adb2-4aaa-9c07-7e6c8822e08f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1510 microversion: 2.1 time: 0.167966 Jul 18 10:45:12.039898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 161/327] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:11 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:45:13.062596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:13.064008 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:13.072143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:13.072591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:13.073488 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:13.075065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:13.218642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:13.226857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8e99fc86-f0db-43b1-8757-7407111f8edc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1510 microversion: 2.1 time: 0.169618 Jul 18 10:45:13.227424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 167/328] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:13 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:14.244940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:14.245592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:14.253269 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:14.253777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:14.254615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:14.255164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:14.455507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:14.463516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-03cff93d-f72f-4e2d-bf68-4b51a43bd2f6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1510 microversion: 2.1 time: 0.222611 Jul 18 10:45:14.464079 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 162/329] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:14 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:15.482905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:15.483528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:15.490786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:15.491329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:15.492121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:15.492691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:15.701214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:15.712199 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-74fc92c9-4f00-4acd-aec3-1281803f1ef1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1510 microversion: 2.1 time: 0.234596 Jul 18 10:45:15.722268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 168/330] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:15 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:16.732629 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:16.734017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:16.744053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:16.745102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:16.746208 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:16.746978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:16.962858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:16.970769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-da00e6a0-c2f4-42e9-9b3e-4c58d32a28fd tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1516 microversion: 2.1 time: 0.242663 Jul 18 10:45:16.972714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 163/331] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:16 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1516 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:18.718479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:18.719026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:18.725991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:18.726483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:18.727473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:18.727915 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:18.755914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b9f3cc66-0b0b-4027-969c-b767483df736 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/ips" status: 200 len: 150 microversion: 2.20 time: 0.041250 Jul 18 10:45:18.756616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 169/332] 10.222.0.47 () {60 vars in 1288 bytes} [Mon Jul 18 10:45:18 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:45:19.523608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9a8ccdf6-c223-448d-b849-21c4be8f448c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: .version_select at 0x7f5f0a8c2790>, body: {"keypair": {"name": "tempest-keypair-1961816394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxpj1pVyhj1Wnbo0u5uo413FQFqEwjvs829xzvkFPDGvq9ftA5T38Ol3/llNQ5Bga+EtfbxxCM1zqFGpUER0PG/B/U72dS5LU3Xd8bXhpyHj+aelH7qC6MmF1wKdSlIdg=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:19.538200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-9a8ccdf6-c223-448d-b849-21c4be8f448c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:45:19.542272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-9a8ccdf6-c223-448d-b849-21c4be8f448c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for user b86d6011a3f04ad0bf5b8be696c789f2 and project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:45:19.667414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9a8ccdf6-c223-448d-b849-21c4be8f448c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.148656 Jul 18 10:45:19.668009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 164/333] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:45:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:20.784253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:20.785466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:20.792203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:20.792650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:20.793456 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:20.793883 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:20.822042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e10cf0b2-daf3-4586-b13c-dee65523adfe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/ips" status: 200 len: 146 microversion: 2.1 time: 0.042259 Jul 18 10:45:20.822635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 170/334] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:45:20 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:22.658759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-203313931", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c142228-b6cb-455d-9edf-375af8a017d1"}], "security_groups": [{"name": "tempest-securitygroup--1579514729"}], "key_name": "tempest-keypair-1961816394", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:22.986225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] validate_networks() for [('4c142228-b6cb-455d-9edf-375af8a017d1', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:45:23.401571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:45:23.402001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:45:23.402477 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:45:23.402887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:45:23.403327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:45:23.412338 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:23.412851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:23.413649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:23.414087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:23.420581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=72,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:23.430900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:45:23.434938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Getting quotas for user b86d6011a3f04ad0bf5b8be696c789f2 and project b0e325a6638442b9a2a929a6525f7c2e. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:45:23.446786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:45:23.449150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:45:23.721577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5e39a07c-4ce1-42a8-8d1a-6f912a08ecf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.067878 Jul 18 10:45:23.722498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 165/335] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:45:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:45:23.732251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5db3a5a5-1b51-4fb5-8cb4-4839432d980c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:23.732894 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5db3a5a5-1b51-4fb5-8cb4-4839432d980c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:23.739979 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=32 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:23.811525 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5db3a5a5-1b51-4fb5-8cb4-4839432d980c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:23.821074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5db3a5a5-1b51-4fb5-8cb4-4839432d980c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1245 microversion: 2.1 time: 0.092686 Jul 18 10:45:23.822019 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 171/336] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:23 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:24.838859 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:24.839503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:24.846992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:24.847436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:24.855189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:24.855189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:24.908432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:24.915628 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-00453b76-4e75-4637-9b6a-9ce9b357a1ee tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1249 microversion: 2.1 time: 0.081030 Jul 18 10:45:24.916195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 166/337] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:24 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:25.243601 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:25.244124 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:25.251980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:25.252427 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:25.253225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:25.253657 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:25.283304 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lazy-loading 'flavor' on Instance uuid f60e0663-4f73-4a3c-b76a-5e1c40a2b432 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:45:25.932911 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:25.933449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:25.940713 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:25.941176 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:25.941925 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:25.942355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:26.005534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:26.012787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-513e8ce2-b96a-498b-9bac-dfc10ccb399f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1249 microversion: 2.1 time: 0.083748 Jul 18 10:45:26.013346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 167/338] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:25 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:45:26.066720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e59fe72b-92a2-4830-9641-aa63685aee81 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/action" status: 202 len: 0 microversion: 2.20 time: 0.826783 Jul 18 10:45:26.067332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 172/339] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Jul 18 10:45:25 2022] POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/action => generated 0 bytes in 828 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:45:26.075874 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:26.076482 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:26.083039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:26.083488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:26.084268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:26.084725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:26.217650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:26.225906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:26.227401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:26.228540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-19d62af5-7fa6-4a45-994f-06a9e04d137f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.156853 Jul 18 10:45:26.229111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 168/340] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:26 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:27.030100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:27.030788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:27.037724 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:27.038169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:27.038963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:27.039347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:27.101269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:27.112819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c58e60f6-3e60-4aa1-bf59-4a1283ba1490 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1249 microversion: 2.1 time: 0.087036 Jul 18 10:45:27.113731 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 173/341] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:27 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:27.247655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:27.248257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:27.254736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:27.255179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:27.255935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:27.256364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:27.392956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:27.400909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:27.402462 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:27.403609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6aefbd3-1510-4162-a8db-71bd6100a34b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.159788 Jul 18 10:45:27.404186 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 169/342] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:27 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:28.129731 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:28.130345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:28.136749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:28.137198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:28.137956 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:28.138393 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:28.200866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:28.209046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1a903053-d510-4222-9541-70a11957275f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1241 microversion: 2.1 time: 0.083028 Jul 18 10:45:28.209613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 174/343] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:28 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:28.423182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:28.423876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:28.429893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:28.430436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:28.431274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:28.431792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:28.560314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:28.569165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:28.570754 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:28.571908 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3a4ad085-fe05-41bd-89cb-21318f398c7b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.152868 Jul 18 10:45:28.572780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 170/344] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:28 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:29.226479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:29.227116 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:29.233404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:29.233850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:29.235545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:29.236041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:29.303659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:29.311485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9c118e4c-f880-4cdf-8575-116ff34fe615 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1297 microversion: 2.1 time: 0.089328 Jul 18 10:45:29.312052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 175/345] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:29 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:29.591752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:29.592280 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:29.598936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:29.599383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:29.600140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:29.600579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:29.726064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:29.733852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:29.736478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:29.737636 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ae599e0-3660-43e3-ac53-cbfb56be862a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.149826 Jul 18 10:45:29.738182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 171/346] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:29 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:30.327607 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:30.328258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:30.335126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:30.335568 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:30.336321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:30.336781 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:30.397665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:30.404821 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3f621771-b71f-4f24-98e5-d435d0198c3e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1297 microversion: 2.1 time: 0.081050 Jul 18 10:45:30.405373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 176/347] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:30 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:30.755975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:30.756530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:30.762543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:30.763012 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:30.763764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:30.764195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:30.895879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:30.907016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:30.908469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:30.909705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b1b656b9-9001-4189-9cce-a0262ff19ff3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.157726 Jul 18 10:45:30.910344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 172/348] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:30 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:31.421920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:31.422634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:31.429598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:31.430058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:31.430845 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:31.431280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:31.496522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:31.504401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-88d540bb-bd2f-474e-ab59-69b3914807fc tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1305 microversion: 2.1 time: 0.086372 Jul 18 10:45:31.505014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 177/349] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:31 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:31.931748 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:31.933010 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:31.949725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:31.950419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:31.951194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:31.951633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:32.085838 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:32.094721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:32.097752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:32.097752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-67a7733b-38f1-4f25-a963-8c370ebd27ec tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.169618 Jul 18 10:45:32.098108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 173/350] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:31 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:32.527305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:32.527949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:32.535093 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:32.535553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:32.536334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:32.536808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:32.680208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:32.689202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1fc16b11-87f9-4053-8e02-f7fda7365fbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.165520 Jul 18 10:45:32.690321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 178/351] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:32 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:33.116646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:33.117804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:33.124188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:33.124710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:33.125499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:33.125953 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:33.260560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:33.270050 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:33.271105 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:33.272309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-605c96a5-6b3b-416a-a911-29d875886ff8 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.159531 Jul 18 10:45:33.272882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 174/352] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:33 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:33.706539 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:33.707129 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:33.713742 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:33.729558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:33.729558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:33.729558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:33.733788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:33.816469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:33.847779 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:33.855691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b074cb70-ec2b-4b9e-b97d-203ad0ccc215 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.153223 Jul 18 10:45:33.856257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 179/353] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:33 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:34.291310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:34.291940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:34.293788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:34.294433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=10 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:34.295072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:34.300334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:34.303549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:34.303549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:34.303549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:34.449034 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:34.461277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:34.462983 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:34.464453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d2f5f236-c121-467a-9291-0de7c5ff59e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.176838 Jul 18 10:45:34.465775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 175/354] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:34 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:34.873283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:34.873933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:34.881691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:34.882137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:34.882893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:34.883324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:35.041002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:35.049228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3597a8a3-d4cc-4d0d-8592-d333d4f319f7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.180274 Jul 18 10:45:35.049810 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 180/355] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:34 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:35.234837 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-caffbf52-9464-4437-b29b-b75775824046 req-777b9397-571d-4900-96fb-e960cb6b183d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:35.246971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-caffbf52-9464-4437-b29b-b75775824046 req-777b9397-571d-4900-96fb-e960cb6b183d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:35.247439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-caffbf52-9464-4437-b29b-b75775824046 req-777b9397-571d-4900-96fb-e960cb6b183d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:35.267189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-caffbf52-9464-4437-b29b-b75775824046 req-777b9397-571d-4900-96fb-e960cb6b183d service nova] Creating event network-changed:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:45:35.267189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-caffbf52-9464-4437-b29b-b75775824046 req-777b9397-571d-4900-96fb-e960cb6b183d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038684 Jul 18 10:45:35.267965 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 176/356] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:35.483604 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:35.484920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:35.491652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:35.492101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:35.492882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:35.493321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:35.628911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:35.636659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:35.638223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:35.639367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f7269ed2-20c2-4d8b-af4b-2034f7e9d194 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.159681 Jul 18 10:45:35.639925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 181/357] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:35 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:36.067005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:36.067734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:36.074451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:36.074899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:36.075661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:36.076088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:36.205729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:36.213117 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7a0f8824-4ec0-45d1-8262-bf77f9b33a27 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.150810 Jul 18 10:45:36.214667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 177/358] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:36 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:36.660382 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:36.660947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:36.667829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:36.668268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:36.669057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:36.669484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:36.801513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:36.809394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:36.811232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:36.812445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-343fd62d-6bec-43c2-bc8b-a3085ce0546e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.158012 Jul 18 10:45:36.813164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 182/359] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:36 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:37.230920 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:37.231529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:37.237874 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:37.238249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:37.239022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:37.239459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:37.368504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:37.376433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-37e12518-9df4-463f-8b6b-4fe85a1f5504 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.149389 Jul 18 10:45:37.377055 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 178/360] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:37 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:37.831140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:37.831871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:37.838497 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:37.838954 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:37.839722 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:37.840161 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:37.970038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:37.978220 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:37.979711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:37.980937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e59d284f-c0cd-43da-a26d-f8767a8ab47f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.154004 Jul 18 10:45:37.981455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 183/361] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:37 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:38.393479 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:38.396629 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:38.402495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:38.403140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:38.404088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:38.404538 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:38.539196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:38.546746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-52b7eab1-fabd-4d1b-ab68-8e528e112d12 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.157753 Jul 18 10:45:38.547354 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 179/362] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:38 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:38.601825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "150059ed-fec9-4c01-9a54-99d0f564d360"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:38.606113 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:38.608972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:38.609426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:38.610336 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:38.610936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:39.001365 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:39.001973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:39.008098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:39.008543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:39.009335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:39.009767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:39.142085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:39.149880 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:39.151351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:39.152474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-365d7486-9cfa-485a-9f6d-401f4e5ae042 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.155070 Jul 18 10:45:39.153046 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 180/363] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:38 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:45:39.564487 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:39.565155 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:39.571005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:39.571477 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:39.572233 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:39.572727 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:39.711500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:39.719249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fa3609dd-563f-4e23-a681-070a4261100c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.159584 Jul 18 10:45:39.719797 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 181/364] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:39 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:45:40.172070 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:40.172675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:40.178689 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:40.179123 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:40.179925 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:40.180357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:40.311686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:40.320552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:40.322225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:40.323515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-77465ab8-5345-4113-a5da-204ebe2401e4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.155792 Jul 18 10:45:40.324137 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 182/365] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:40 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:45:40.529048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-578a37dc-796a-47b5-9650-242c430dc67c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.930939 Jul 18 10:45:40.529799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 184/366] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:45:38 2022] POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments => generated 194 bytes in 1933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:45:40.736202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:40.736856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:40.742831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:40.743339 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:40.744049 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:40.744482 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:40.748425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:40.877596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:40.884875 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2f54f429-3ce7-49dd-b0b0-0f615ecf4218 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.153462 Jul 18 10:45:40.885431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 183/367] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:40 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:41.342574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:41.344526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:41.351127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:41.351601 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:41.352350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:41.352798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:41.479101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:41.487504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:41.489038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:41.490182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c67120ff-8083-4f26-996d-6288d700376e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.151747 Jul 18 10:45:41.490740 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 185/368] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:41 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:41.901504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:41.902052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:41.908550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:41.909021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:41.909775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:41.910207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:42.038138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:42.045529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5571ab4c-f73d-4a36-97de-f149ae30ffa2 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.147964 Jul 18 10:45:42.046108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 184/369] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:41 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:42.508142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:42.508809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:42.515205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:42.515652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:42.516878 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:42.517320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:42.647930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:42.656482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:42.658219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:42.659362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-34c0378a-43c5-4f29-a85b-fbecaa412967 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.155056 Jul 18 10:45:42.659952 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 186/370] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:42 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:43.071172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:43.071824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:43.078748 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:43.079347 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:43.080405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:43.080832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:43.209698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:43.217557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dd8770e1-39cb-4231-84d7-f8421fc27bf1 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.150513 Jul 18 10:45:43.218714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 185/371] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:43 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:43.677762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:43.678303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:43.684654 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:43.685145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:43.685906 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:43.686344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:43.835504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:43.853048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:43.855345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:43.856672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-faa86a7a-10ba-4ef9-8988-df26c7bf7ac0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.182875 Jul 18 10:45:43.861211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 187/372] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:43 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:44.235135 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:44.235749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:44.241669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:44.242115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:44.242873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:44.243301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:44.378019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:44.385329 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-22aad828-14e6-43d9-83d5-82e9fc82b71e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.154195 Jul 18 10:45:44.385896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 186/373] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:44 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:44.836386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-6380fbf1-ca82-45a2-8603-948ef7a35c67 req-42caec9b-80df-4ae4-903f-cfec3dd147cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "name": "network-vif-plugged", "status": "completed", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:44.845867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-6380fbf1-ca82-45a2-8603-948ef7a35c67 req-42caec9b-80df-4ae4-903f-cfec3dd147cc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:44.846617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-6380fbf1-ca82-45a2-8603-948ef7a35c67 req-42caec9b-80df-4ae4-903f-cfec3dd147cc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:44.860562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-6380fbf1-ca82-45a2-8603-948ef7a35c67 req-42caec9b-80df-4ae4-903f-cfec3dd147cc service nova] Creating event network-vif-plugged:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:45:44.865936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-6380fbf1-ca82-45a2-8603-948ef7a35c67 req-42caec9b-80df-4ae4-903f-cfec3dd147cc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034044 Jul 18 10:45:44.866917 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 188/374] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:44.875592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:44.876167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:44.883440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:44.891531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:44.891531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:44.891531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.067614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:45.079431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:45.081213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:45.082359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33fdb1ee-4cae-4d1b-be0e-d0cd4636ecdb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.211098 Jul 18 10:45:45.082918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 187/375] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:44 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:45.208011 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:45.208893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:45.218603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.219294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.220441 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.221214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.235570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:45.236629 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:45.245711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.246448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.253820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.254793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.283819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c9dd9624-348b-4df0-a74d-3a12990957e8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/ips" status: 200 len: 149 microversion: 2.1 time: 0.082088 Jul 18 10:45:45.284700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 189/376] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:45:45 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/ips => generated 149 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:45.404748 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:45.406300 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:45.422841 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.423563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.432795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lazy-loading 'services' on Instance uuid dec0babc-bd9d-46f7-9045-011b4cbb5356 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:45:45.433365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:45.433829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:45.590072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:45.598203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c02468df-2c31-4b8a-8779-d8ce1b1c9803 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.198912 Jul 18 10:45:45.598780 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 190/377] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:45 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:45.790571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-83ba7b99-48e3-4611-9853-3e2625451083 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356/os-volume_attachments/9edfa22e-4709-4119-8e6f-d972e9795e50" status: 202 len: 0 microversion: 2.1 time: 0.561756 Jul 18 10:45:45.809923 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 188/378] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:45:45 2022] DELETE /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356/os-volume_attachments/9edfa22e-4709-4119-8e6f-d972e9795e50 => generated 0 bytes in 580 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:45:46.101976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:46.102670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:46.117954 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:46.118412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:46.119189 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:46.119641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:46.259573 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:46.276182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:46.285833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:46.287067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-011f213b-af9b-40a6-b739-b3c1075d5071 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.189611 Jul 18 10:45:46.291288 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 191/379] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:46 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:46.617808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:46.618633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:46.627593 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:46.630825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:46.631650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:46.632086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:46.792988 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:46.801724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f0c24661-90e1-4336-919e-6b16f7536874 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1371 microversion: 2.1 time: 0.190140 Jul 18 10:45:46.802374 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 189/380] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:46 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:47.168481 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c151d374-bf48-41f8-a9d5-7ac7a892cd62"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:47.169628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:47.176807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.177334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.178112 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.178551 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.309168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:47.309786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:47.315986 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.316438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.317255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.317669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.449660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:47.458309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:47.459804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:47.460971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c78f4469-0fae-4903-88e2-0a137c9150ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.155737 Jul 18 10:45:47.461533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 190/381] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:47 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:45:47.818871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:47.819477 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:47.825414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.825861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.826609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:47.827037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:47.986981 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:47.997044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b25e67a1-b3e9-4578-a031-b0ef500258c0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1566 microversion: 2.1 time: 0.182018 Jul 18 10:45:47.997618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 191/382] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:47 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:48.013363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:48.013859 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:48.021635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:48.022302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:48.023573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:48.024364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:48.116107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8b3d7d26-1956-4543-8127-510322298131 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106490 Jul 18 10:45:48.116709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 192/383] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:45:48 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:45:48.480375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:48.481053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:48.488164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:48.488627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:48.489499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:48.489933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:48.570024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7b503834-34e5-4d1f-8fb0-86cd25ee258d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.405316 Jul 18 10:45:48.577149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 192/384] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:45:47 2022] POST /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments => generated 194 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:48.826161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:48.835272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:48.856650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:48.856650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c06fa99f-df0e-496a-987d-26360f2f8f12 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1743 microversion: 2.20 time: 0.361592 Jul 18 10:45:48.856650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 193/385] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:48 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1743 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:49.816971 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-c3aed18d-3c86-4f53-a061-ea3fca8523b5 req-75210564-a9d6-4acc-b42b-74b72a56c470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:49.828394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c3aed18d-3c86-4f53-a061-ea3fca8523b5 req-75210564-a9d6-4acc-b42b-74b72a56c470 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:49.830887 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-c3aed18d-3c86-4f53-a061-ea3fca8523b5 req-75210564-a9d6-4acc-b42b-74b72a56c470 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:49.844057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-c3aed18d-3c86-4f53-a061-ea3fca8523b5 req-75210564-a9d6-4acc-b42b-74b72a56c470 service nova] Creating event network-changed:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:45:49.849357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-c3aed18d-3c86-4f53-a061-ea3fca8523b5 req-75210564-a9d6-4acc-b42b-74b72a56c470 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039545 Jul 18 10:45:49.857796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:49.859061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:49.864116 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 193/386] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:49.866378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:49.867027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:49.867948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:49.868529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:50.031145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:50.041655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:50.043428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:50.045035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-03793f49-a6ea-4be6-b31e-40e02943930b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1743 microversion: 2.20 time: 0.190721 Jul 18 10:45:50.047057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 194/387] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:49 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1743 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:51.076202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:51.077804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:51.103817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:51.108788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:51.110139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:51.110139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:51.340212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:51.350296 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:51.352162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:51.353548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-972010cd-f226-4033-9aa3-05f95c2aa503 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1743 microversion: 2.20 time: 0.291018 Jul 18 10:45:51.355193 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 194/388] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:51 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1743 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:51.456364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d618021f-8021-4aa2-a03a-78eaeff44a14 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:51.466849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d618021f-8021-4aa2-a03a-78eaeff44a14 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:51.467556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d618021f-8021-4aa2-a03a-78eaeff44a14 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:51.534276 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d618021f-8021-4aa2-a03a-78eaeff44a14 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Going to try to stop instance {{(pid=124843) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:45:51.803881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d618021f-8021-4aa2-a03a-78eaeff44a14 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action" status: 202 len: 0 microversion: 2.1 time: 0.349285 Jul 18 10:45:51.803881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 195/389] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:45:51 2022] POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:45:51.810851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:51.811622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:51.818441 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:51.819378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:51.820642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:51.821111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:51.825440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:51.966376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:51.975115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ccaee9e5-ff8e-48df-99bc-4e55d2ef41ac tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.168844 Jul 18 10:45:51.975729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 195/390] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:51 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:52.373936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:52.374571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:52.381124 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:52.381574 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:52.382371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:52.382805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:52.522280 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:52.531615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:52.533282 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:52.534615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e832b7b6-bcf8-4224-8cc5-d0842ca9779b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1743 microversion: 2.20 time: 0.165061 Jul 18 10:45:52.535746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 196/391] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:52 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:52.791345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ee61f74a-810f-4c8a-941b-00a746d3aaa3 req-90ab445a-280d-49b9-a4fd-bf76f926a98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "name": "network-vif-plugged", "status": "completed", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:52.801391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ee61f74a-810f-4c8a-941b-00a746d3aaa3 req-90ab445a-280d-49b9-a4fd-bf76f926a98b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:52.801840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ee61f74a-810f-4c8a-941b-00a746d3aaa3 req-90ab445a-280d-49b9-a4fd-bf76f926a98b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:52.814912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ee61f74a-810f-4c8a-941b-00a746d3aaa3 req-90ab445a-280d-49b9-a4fd-bf76f926a98b service nova] Creating event network-vif-plugged:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:45:52.819606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ee61f74a-810f-4c8a-941b-00a746d3aaa3 req-90ab445a-280d-49b9-a4fd-bf76f926a98b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032409 Jul 18 10:45:52.820588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 196/392] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:45:52.993002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:52.993613 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:53.000366 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:53.000846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:53.001609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:53.002045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:53.144632 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:53.156255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a7be9af3-d9f7-4fb7-8717-2bbb7450efdc tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.164858 Jul 18 10:45:53.156863 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 197/393] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:52 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:53.557561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:53.559804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:53.567897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:53.568358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:53.569242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:53.570334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:53.719254 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:53.727727 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:53.729267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:53.730431 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ec67cb4a-378b-434c-b5c8-e89ebc9de133 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.181063 Jul 18 10:45:53.731030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 197/394] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:53 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:54.176330 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:54.177554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:54.190685 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.191456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:54.192863 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.193865 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:54.225914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:54.389141 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:54.397906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0a6dbb89-b6ca-46c3-9aa5-bdc83a398be7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.227174 Jul 18 10:45:54.399152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 198/395] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:54 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:54.539467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:54.541793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:54.555173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.555761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:54.564735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.565203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:54.603315 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:45:54.773110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:54.785008 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:54.792641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.795469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:54.798066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:54.804552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:55.000280 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:55.020096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:55.022075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:55.023539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1b3dec9a-a932-4b2f-ac94-2145c84dbbb5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.276794 Jul 18 10:45:55.024442 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 199/396] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:54 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:55.423346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:55.424832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:55.431641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:55.432714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:55.433745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:55.435006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:55.461905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=58 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:45:55.604580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-46432160-4c4d-4fc4-a3eb-efdbdb748ab7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "DELETE /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 204 len: 0 microversion: 2.1 time: 1.070296 Jul 18 10:45:55.605252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 198/397] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:45:54 2022] DELETE /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 0 bytes in 1072 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:45:55.615143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:55.615874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:55.623175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:55.624670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:55.625720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:55.626400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:55.635165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:55.646271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bdb6d7d0-de0f-4530-aaf3-b79c566c021b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.227743 Jul 18 10:45:55.647305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 200/398] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:55 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:55.858961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:55.858961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9924c115-028c-4e2c-a7cb-b315db3068d2 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1513 microversion: 2.1 time: 0.228959 Jul 18 10:45:55.858961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 199/399] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:55 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1513 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:56.043292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:56.044361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:56.051753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.052521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:56.053744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.054371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:56.250255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:56.259320 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:56.260862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:56.262021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b995e772-0a15-4634-aedd-45f8e4cacf18 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.222940 Jul 18 10:45:56.262767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 201/400] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:56 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:56.665627 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:56.666361 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:56.674134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.674575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:56.675339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.675769 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:56.828320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:56.835679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dfe9c654-2f28-43ab-ab58-90b1bfd8fa4c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.173967 Jul 18 10:45:56.836292 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 200/401] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:56 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:56.874771 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:56.875389 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:56.881442 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.881991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:56.882730 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:56.883166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:57.054388 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:57.063315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3a2f8015-a33e-4204-8d06-e812d5964495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1513 microversion: 2.1 time: 0.192712 Jul 18 10:45:57.063884 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 202/402] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:56 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:45:57.287792 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:57.289325 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:57.300017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:57.300754 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:57.301752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:57.302185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:57.456419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:57.465591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:57.468142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:57.469472 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1b149c74-df59-4457-8ea1-cae83bc209fc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.190279 Jul 18 10:45:57.470239 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 201/403] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:57 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:57.855046 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:57.855262 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:57.862487 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:57.862937 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:57.863758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:57.864191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:58.021784 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:58.031740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7cfcb8ac-eb98-4989-8a1b-54a46af98a02 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.181424 Jul 18 10:45:58.032559 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 203/404] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:57 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:58.083021 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:58.083670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:58.090762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:58.091221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:58.091991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:58.093005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:58.242360 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:58.258547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ea0ff7d0-a4cd-4692-a0a6-c482d36244d1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1513 microversion: 2.1 time: 0.181192 Jul 18 10:45:58.259174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 202/405] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:58 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1513 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:45:58.487640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:58.488362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:58.495167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:58.495618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:58.496456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:58.496931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:58.748374 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:58.758422 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:58.762433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:58.762433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-906075d3-a7ef-4b0b-9c61-7a93e912881a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.278284 Jul 18 10:45:58.762939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 204/406] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:58 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:45:59.056062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:59.058086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:59.070465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.073301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.077297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.078238 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.146146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-488f293c-5b03-4da3-bcce-c4cf697cb161 req-6fc50560-5f1c-40e7-accf-2e99cbe51e13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dec0babc-bd9d-46f7-9045-011b4cbb5356", "name": "network-vif-deleted", "tag": "81ec280a-fd52-4eaf-8791-4aadd2f2c0bf"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:45:59.167550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-488f293c-5b03-4da3-bcce-c4cf697cb161 req-6fc50560-5f1c-40e7-accf-2e99cbe51e13 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.170778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-488f293c-5b03-4da3-bcce-c4cf697cb161 req-6fc50560-5f1c-40e7-accf-2e99cbe51e13 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.181781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-488f293c-5b03-4da3-bcce-c4cf697cb161 req-6fc50560-5f1c-40e7-accf-2e99cbe51e13 service nova] Creating event network-vif-deleted:81ec280a-fd52-4eaf-8791-4aadd2f2c0bf for instance dec0babc-bd9d-46f7-9045-011b4cbb5356 on hv-cinder-84617 Jul 18 10:45:59.189290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-488f293c-5b03-4da3-bcce-c4cf697cb161 req-6fc50560-5f1c-40e7-accf-2e99cbe51e13 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046207 Jul 18 10:45:59.190541 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 205/407] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:45:59.288100 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:59.290743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:59.307075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:59.318036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.322167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-38a62183-6490-4894-a300-793e94ff563f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.275524 Jul 18 10:45:59.328369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.330520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.335470 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.340331 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 203/408] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:59 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:59.509428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:45:59.539657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f913ca1b-f1c0-4166-9534-06641ff278b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1303 microversion: 2.1 time: 0.255007 Jul 18 10:45:59.539657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 206/409] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:45:59 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1303 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:45:59.789813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:45:59.790461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:45:59.808717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.809357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:45:59.810472 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:45:59.810907 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.005512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:00.015468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:00.017674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:00.018746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d58811a0-0a28-4d39-ba98-f1fccd840f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.236139 Jul 18 10:46:00.019655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 204/410] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:45:59 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:00.340551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:00.341287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:00.347678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:00.348124 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.348937 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:00.349370 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.501215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:00.527864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3264c4eb-a26c-4904-bd3f-9cda8f62af60 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.191003 Jul 18 10:46:00.528353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 207/411] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:00 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:00.547436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:00.548115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:00.554423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:00.554861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.555607 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:00.556031 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.590568 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:00.591080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:00.591556 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lazy-loading 'fault' on Instance uuid dec0babc-bd9d-46f7-9045-011b4cbb5356 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:46:00.640873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:00.647585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4d5654e1-fc33-4b22-b4d1-1a9e8d942bcf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1308 microversion: 2.1 time: 0.104998 Jul 18 10:46:00.648141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 205/412] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:00 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1308 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:01.039966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:01.040578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:01.047199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.055664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.055664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.055664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.213851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:01.223928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:01.225566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:01.226816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-09774354-c263-4d7a-8750-569062a156da tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.190978 Jul 18 10:46:01.227333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 208/413] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:01 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:01.548047 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:01.551559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:01.566203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.566784 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.567629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.568159 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.665601 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:01.666144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:01.673027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.673506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.674529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.675128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.720702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:01.721249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:01.721786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lazy-loading 'fault' on Instance uuid dec0babc-bd9d-46f7-9045-011b4cbb5356 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:46:01.798525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:01.806388 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:01.815965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0a8d6b7f-cebf-41e1-8c78-555558b5af30 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.273435 Jul 18 10:46:01.816467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cc9b33a7-79a7-49bf-83fa-ff9223cb4676 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 200 len: 1308 microversion: 2.1 time: 0.154790 Jul 18 10:46:01.817134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 209/414] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:01 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 1308 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:01.827059 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 206/415] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:01 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:02.056553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4d18c378-9daa-491f-9fd7-02ac7d9a42c1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: .version_select at 0x7f5f0a918b80>, body: {"keypair": {"name": "tempest-keypair-642224676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQxnacqaECUFHCDEFrsKOTcT7keYN9rq/ZfvYAV4TVggTeeXQJ6YPceZvSoQoZhSVOgywWRzEeGqtYaaJo5wKss7aEo9leYJGQt26y012AM5rCv7hIASbMKQE1vD4cBlw=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:02.085531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4d18c378-9daa-491f-9fd7-02ac7d9a42c1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:46:02.091462 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4d18c378-9daa-491f-9fd7-02ac7d9a42c1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:46:02.212083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4d18c378-9daa-491f-9fd7-02ac7d9a42c1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.159912 Jul 18 10:46:02.212605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 210/416] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:46:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:02.272987 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:02.274951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:02.282534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.283079 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.283934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.284443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.454985 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:02.466349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:02.468812 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:02.470176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e42479d2-6eb3-4735-92cd-806f345474c0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.222452 Jul 18 10:46:02.471328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 207/417] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:02 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:02.835987 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:02.840779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:02.842693 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: dec0babc-bd9d-46f7-9045-011b4cbb5356] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:02.843617 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:02.855843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.858448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.858448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.859944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.860374 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.861505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.862883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:02.863452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:02.882194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] HTTP exception thrown: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Request method failure captured: Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 HTTP/1.1 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlpkGAXJSis_EIEmN6OfWEuP3NLCyy_a43BVHNZkD5R2oLqT4ZIiUa9Izegb60IVd5RlrmWlQ5sp2h5dqwrUO7phc8CiycI2dD-5seRPl684O6F7GOjy-3wZ_W1zz1rNqpHjUQgrQRWyeZIg4sWuU3wZvGGkV5TmhH7VqURWQyeayI Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: bac9bcfdd4ef4a6d87f593bde0c352c9 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:46:02.883889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}] Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bac9bcfdd4ef4a6d87f593bde0c352c9 Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotTestJSON-1915935287-project Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: f862a8b7b4534d1ba7d65b4688c32b92 Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotTestJSON-1915935287-project Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. Jul 18 10:46:02.885486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'dec0babc-bd9d-46f7-9045-011b4cbb5356'} Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:46:02.886429 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. Jul 18 10:46:02.887938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:46:02.889739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Returning 404 to user: Instance dec0babc-bd9d-46f7-9045-011b4cbb5356 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:46:02.889739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-92ca73c0-d12a-43b1-8d24-0c87125ae1a8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356" status: 404 len: 111 microversion: 2.1 time: 0.053160 Jul 18 10:46:02.890386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 208/418] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:02 2022] GET /compute/v2.1/servers/dec0babc-bd9d-46f7-9045-011b4cbb5356 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:46:03.085789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:03.096757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-28d20ed3-ad58-4c9e-8d3d-170eeeffc533 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.265692 Jul 18 10:46:03.097979 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 211/419] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:02 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:03.489797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:03.490403 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:03.496552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:03.497238 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:03.498179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:03.499451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:03.698028 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:03.712206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:03.712206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:03.712928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-464f280f-096d-496d-94c5-6c752fb9b3a5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.227111 Jul 18 10:46:03.726347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 209/420] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:03 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:04.114543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:04.115182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:04.121406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:04.121852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:04.122614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:04.123051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:04.258433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:04.268087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d15e2a40-68ab-4c33-9677-e7cb7ed394f9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.157387 Jul 18 10:46:04.268654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 212/421] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:04 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:04.734033 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:04.735774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:04.743467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:04.744262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:04.745504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:04.746235 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:04.905997 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:04.916959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:04.918829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:04.921256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a4d92007-288d-47fb-98a8-1afb262057f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.191485 Jul 18 10:46:04.922005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 210/422] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:04 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:05.288605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:05.289361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:05.305119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:05.305119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:05.305119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:05.305119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:05.466918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:05.475543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a4873772-5ac6-4d54-a42b-897dd85ac860 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.193069 Jul 18 10:46:05.476108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 213/423] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:05 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:05.939473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:05.940068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:05.946700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:05.947148 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:05.947970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:05.948406 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:05.952671 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:06.087256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:06.096457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:06.098308 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:06.099737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ba90e83b-ac17-4946-9db6-b667c14aecb4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.164379 Jul 18 10:46:06.100490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 211/424] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:05 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:06.340635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1766639556", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c67416e9-65e7-4c80-a421-5c4140e97b67"}], "security_groups": [{"name": "tempest-securitygroup--744442637"}], "key_name": "tempest-keypair-642224676", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:06.348164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:06.464557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] validate_networks() for [('c67416e9-65e7-4c80-a421-5c4140e97b67', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:46:06.492970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:06.493577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:06.501369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:06.505479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:06.505479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:06.505479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:06.703268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:06.713047 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-33d3534d-aecc-4e44-aa52-230627ffc302 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.223981 Jul 18 10:46:06.713638 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 212/425] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:06 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:06.934161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:46:06.934587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:46:06.935055 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:46:06.935460 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:46:06.935924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:46:06.945315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:06.949313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:06.949313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:06.949313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:06.963244 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:46:06.967662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:46:06.978605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:46:06.980874 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:46:07.119081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:07.119621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:07.126532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:07.127217 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:07.127734 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:07.128171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:07.132591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-65c49bf5-954b-4bd8-9119-9a8e56d4d51e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.796150 Jul 18 10:46:07.136345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 214/426] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:46:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:46:07.143515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-89ee9eda-d681-4ac4-890d-4b75d9b26141 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:07.144200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-89ee9eda-d681-4ac4-890d-4b75d9b26141 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:07.234521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-89ee9eda-d681-4ac4-890d-4b75d9b26141 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:07.242251 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-89ee9eda-d681-4ac4-890d-4b75d9b26141 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1241 microversion: 2.1 time: 0.102961 Jul 18 10:46:07.243362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 215/427] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:07 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1241 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:07.304530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:07.313509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:07.315020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:07.316340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e8603c2c-005d-4135-8e1a-d1eb80c3e959 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.201656 Jul 18 10:46:07.316937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 213/428] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:07 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:07.731298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:07.732565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:07.741217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:07.742805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:07.743191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:07.743754 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:07.902349 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:07.910623 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bb848d71-d394-40d7-bdd0-745b44d6cae0 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.183121 Jul 18 10:46:07.911188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 216/429] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:07 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:08.259866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:08.260510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:08.268519 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.268998 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:08.269953 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.270392 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:08.335714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:08.336592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:08.337306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:08.345187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c8fefaa7-dc65-4913-aa16-74699b986c95 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1245 microversion: 2.1 time: 0.089329 Jul 18 10:46:08.352499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.352499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:08.352499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.352974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 214/430] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:08 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1245 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:08.353069 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:08.494464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:08.502906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:08.504768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:08.506271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-68d78865-ddf5-4bb8-ab93-667fd03905af tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1738 microversion: 2.20 time: 0.174898 Jul 18 10:46:08.506673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 217/431] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:08 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:08.927672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:08.928290 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:08.944790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.945332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:08.946185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:08.946639 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:09.096839 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:09.104474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d1b62d9-9d5f-4ea5-b230-f7b1284e20a8 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.180817 Jul 18 10:46:09.105059 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 215/432] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:08 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:09.363582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:09.364192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:09.370582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:09.371062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:09.371879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:09.372310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:09.375505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:09.435727 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:09.444134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2bc6f18d-e814-4c26-b4a3-9d0ae2786d0e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1237 microversion: 2.1 time: 0.085353 Jul 18 10:46:09.450259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 218/433] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:09 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:09.526137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:09.526744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:09.533941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:09.534474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:09.535250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:09.535684 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:09.674485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:09.682592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:09.684068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:09.685371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e48631d0-7884-4db0-82c2-93111751497e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.163075 Jul 18 10:46:09.686702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 216/434] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:09 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:10.121677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:10.122400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:10.129604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.130202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.130966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.131406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.264627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:10.272699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce2d88f4-40d0-404a-b4c2-f47320eb0a17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.154811 Jul 18 10:46:10.273277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 219/435] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:10 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:10.461435 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:10.462201 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:10.470013 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.470013 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.470850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.471395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.534977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:10.542174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ce26fa82-30f5-4eaa-8d47-b59f157753c7 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.084596 Jul 18 10:46:10.542763 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 217/436] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:10 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:10.713019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:10.713641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:10.720033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.720478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.721264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:10.721698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:10.855343 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:10.864660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:10.866178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:10.867323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1ad387dd-6030-4f47-9e95-99be72aff389 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.158332 Jul 18 10:46:10.867878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 220/437] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:10 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:11.290533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:11.296846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:11.298094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.298548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:11.299314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.299752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:11.433492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:11.441445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d58b981-5008-4e22-98be-2c67ccb27a24 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.154706 Jul 18 10:46:11.443069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 218/438] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:11 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:11.559749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:11.560376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:11.566753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.571791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:11.571791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.571791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:11.628928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:11.636261 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e9d89622-d987-4037-a529-82524726daec tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.080862 Jul 18 10:46:11.636849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 221/439] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:11 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:11.888982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:11.889792 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:11.896324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.896804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:11.897567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:11.898002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:12.032730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:12.040915 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:12.042700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:12.043883 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ed33a49a-eab1-41a1-b172-585ad6c94230 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.161274 Jul 18 10:46:12.044443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 219/440] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:11 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:12.457765 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:12.458376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:12.464333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:12.464808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:12.465563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:12.465995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:12.596986 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:12.605016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5199a29f-76e7-48b1-898c-3611605fc64c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.151282 Jul 18 10:46:12.605576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 222/441] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:12 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:12.653236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:12.653796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:12.660237 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:12.660690 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:12.661455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:12.661885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:12.727283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:12.735264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-901482aa-23dd-40fe-b24e-96fb9be1f539 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.085864 Jul 18 10:46:12.735819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 220/442] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:12 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:13.008933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-6c8c3130-71fe-4b43-a9bd-7e8b2dde4d13 req-052356bd-9173-4e55-9076-c8dc12483564 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "name": "network-vif-unplugged", "status": "completed", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:13.018162 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6c8c3130-71fe-4b43-a9bd-7e8b2dde4d13 req-052356bd-9173-4e55-9076-c8dc12483564 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.018596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6c8c3130-71fe-4b43-a9bd-7e8b2dde4d13 req-052356bd-9173-4e55-9076-c8dc12483564 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.029723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-6c8c3130-71fe-4b43-a9bd-7e8b2dde4d13 req-052356bd-9173-4e55-9076-c8dc12483564 service nova] Creating event network-vif-unplugged:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:46:13.034673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-6c8c3130-71fe-4b43-a9bd-7e8b2dde4d13 req-052356bd-9173-4e55-9076-c8dc12483564 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029421 Jul 18 10:46:13.035268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 223/443] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:13.063539 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:13.064134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:13.070645 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.071125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.071882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.072315 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.429322 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:13.438945 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:13.440480 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:13.441683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-815bff02-498c-478e-8ab2-86e5a4668473 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.382730 Jul 18 10:46:13.442454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 221/444] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:13 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:13.623905 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:13.624556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:13.630747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.631197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.631954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.632396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.751898 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:13.752602 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:13.758773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.759307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.760139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:13.760238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:13.760740 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:13.769195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dca8ff67-acb8-4bc6-a47d-a82cf729dd1e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1722 microversion: 2.1 time: 0.150086 Jul 18 10:46:13.769771 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 224/445] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:13 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:13.823042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:13.830702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e40e35f4-349c-4123-95f4-0c3cdcf2b131 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.083352 Jul 18 10:46:13.831257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 222/446] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:13 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:14.461662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:14.462270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:14.468876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.469324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:14.470082 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.470516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:14.626721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:14.634619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:14.636095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:14.637260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2531163b-d0d2-41c0-8c27-8400acca43e3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.179495 Jul 18 10:46:14.637813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 225/447] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:14 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:14.786250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:14.786864 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:14.793531 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.794190 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:14.795450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.795908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:14.851581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1924379431", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "networks": [{"uuid": "ae7ec4d1-f13d-4127-bcd6-3269473466ec"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:14.902441 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] validate_networks() for [('ae7ec4d1-f13d-4127-bcd6-3269473466ec', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:46:14.959303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:14.967869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-515eb344-abe4-4497-8d40-ffd13171dd85 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1699 microversion: 2.1 time: 0.185298 Jul 18 10:46:14.968443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 223/448] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:14 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1699 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:14.972947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:14.973548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:14.979660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.980104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:14.980895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:14.981326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.069005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.077804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-53cb1a7b-c332-4386-8087-764fa7e1969d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.107992 Jul 18 10:46:15.078774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 224/449] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:14 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:15.083555 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e548fd20-a6b3-4722-ae6e-0ff34b056ab2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:15.089926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e548fd20-a6b3-4722-ae6e-0ff34b056ab2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.090368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e548fd20-a6b3-4722-ae6e-0ff34b056ab2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.152362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e548fd20-a6b3-4722-ae6e-0ff34b056ab2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Going to try to start instance {{(pid=124844) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:46:15.308915 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:46:15.309562 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:46:15.310080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:46:15.311420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:46:15.312174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:46:15.325160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.325616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.326502 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.326938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.345718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Getting quotas for project bac9bcfdd4ef4a6d87f593bde0c352c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:46:15.350586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Getting quotas for user f862a8b7b4534d1ba7d65b4688c32b92 and project bac9bcfdd4ef4a6d87f593bde0c352c9. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:46:15.362778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:46:15.365063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:46:15.419149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e548fd20-a6b3-4722-ae6e-0ff34b056ab2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action" status: 202 len: 0 microversion: 2.1 time: 0.339134 Jul 18 10:46:15.420268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 225/450] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:46:15 2022] POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:46:15.428591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:15.429313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:15.436351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.436829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.437694 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.438117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.526244 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6269056b-64d0-4659-8891-a7f1d7e54e9e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678483 Jul 18 10:46:15.527067 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 226/451] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:46:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:46:15.536895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ffd11895-a83e-40cb-9685-15af6c763986 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:15.537513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ffd11895-a83e-40cb-9685-15af6c763986 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:15.610490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ffd11895-a83e-40cb-9685-15af6c763986 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.618305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ffd11895-a83e-40cb-9685-15af6c763986 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1219 microversion: 2.1 time: 0.085166 Jul 18 10:46:15.628546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.628897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 227/452] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:15 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:15.632739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:15.637806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-273334b2-676a-490e-96c8-8776ff2a4215 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1708 microversion: 2.1 time: 0.213206 Jul 18 10:46:15.638774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 226/453] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:15 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1708 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:15.657267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:15.658033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:15.664623 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.665189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.665992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:15.666428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:15.821892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.830471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.831971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:15.833154 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f0fcb020-f1af-4b84-a54d-c0df6590a29a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.181763 Jul 18 10:46:15.833718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 228/454] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:15 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:16.096120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:16.097175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:16.104099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.104546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.105390 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.105822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.176105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:16.184024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5c355757-a0ea-49a7-ae0e-9983cafa9298 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.092500 Jul 18 10:46:16.184771 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 227/455] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:16 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:16.636464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:16.637548 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:16.643966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.644419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.645232 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.646011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.658227 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:16.658885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:16.668317 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.668804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.669580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.670842 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.712943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:16.721038 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07a9930a-0421-4b5f-9d1e-b3e4f7d62d84 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1223 microversion: 2.1 time: 0.088180 Jul 18 10:46:16.721545 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 229/456] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:16 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:16.809553 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:16.817423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-447e10c4-aec0-4532-9126-73c68f2a75e2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1708 microversion: 2.1 time: 0.164424 Jul 18 10:46:16.817980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 228/457] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:16 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:16.853212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:16.853827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:16.859806 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.860254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.861039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:16.861481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:16.989432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:16.997178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:16.999025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:17.000169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-afd9c36f-5130-4a11-b2c2-9ecfb83636ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1720 microversion: 2.20 time: 0.150961 Jul 18 10:46:17.000740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 230/458] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:16 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:17.202524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:17.203177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:17.209865 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.210318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.211074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.211508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.274680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:17.283834 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e0a373c-0023-4daa-a8ba-a8c7864a43cd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1293 microversion: 2.1 time: 0.086167 Jul 18 10:46:17.284411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 229/459] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:17 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:17.737243 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:17.737992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:17.743875 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.744308 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.745162 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.745530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.811036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:17.818363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7cdc933c-e752-4a43-abfa-a7377c40e09c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1223 microversion: 2.1 time: 0.085024 Jul 18 10:46:17.818919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 231/460] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:17 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:17.834919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:17.835532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:17.842067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.842674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.843435 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:17.843871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:17.982840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:17.992075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ded5bdc9-83e3-495c-87c6-ac9dc55d5aaa tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1708 microversion: 2.1 time: 0.160989 Jul 18 10:46:17.992646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 230/461] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:17 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1708 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:18.018427 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:18.019041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:18.025302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.025752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.026523 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.026958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.166149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:18.175291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:18.176907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:18.178204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d94475ed-9a66-42d3-aa91-3f7cdc42d718 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1723 microversion: 2.20 time: 0.163592 Jul 18 10:46:18.178884 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 232/462] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:18 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:18.198804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7fe5214-d602-44e1-a10a-9edfa5535005"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:18.200947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:18.209082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.209768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.210291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.210730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.302546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:18.303332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:18.310630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.311172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.312064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.312501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.380943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:18.388646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e8708c4a-a0e4-4990-b01f-67ea6a1c8109 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1301 microversion: 2.1 time: 0.090881 Jul 18 10:46:18.389581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 233/463] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:18 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1301 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:18.836336 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:18.837007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:18.844119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.844579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.845386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:18.845812 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:18.916454 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:18.924885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-61519745-5219-4f3b-a719-57733ab707c7 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1271 microversion: 2.1 time: 0.093181 Jul 18 10:46:18.925414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 234/464] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:18 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:19.010048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:19.010701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:19.017534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.018000 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.021672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.021672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.161708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:19.170924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f7f204c7-0853-4278-8ff2-68f7fcf77503 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1708 microversion: 2.1 time: 0.164570 Jul 18 10:46:19.171538 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 235/465] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:19 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:19.405422 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:19.406045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:19.412191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.412640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.413438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.413870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.573797 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:19.581528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1116d9b1-ebc4-400f-9f21-1b9e9ac5bd67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.180113 Jul 18 10:46:19.582085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 236/466] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:19 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:19.940626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:19.942452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:19.960041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.960579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.961506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:19.962583 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:19.968731 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:20.031936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:20.047752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-79bfdc6f-45d4-4d0e-af0c-77922165e583 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1289 microversion: 2.1 time: 0.110818 Jul 18 10:46:20.057244 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 237/467] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:19 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1289 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:20.188372 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:20.189124 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:20.195085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.195533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.196297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.196758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.221071 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-134c0130-f665-4bfd-a894-1f160d07060d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.026228 Jul 18 10:46:20.227227 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 231/468] 10.222.0.47 () {62 vars in 1363 bytes} [Mon Jul 18 10:46:18 2022] POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments => generated 188 bytes in 2035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:46:20.391241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:20.392083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:20.399593 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.400219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.401178 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.401774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.403844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:20.415167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-66bb0542-c038-4189-a4c4-bb5fbda36371 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1708 microversion: 2.1 time: 0.231534 Jul 18 10:46:20.425635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 238/469] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:20 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:20.606206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:20.608427 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:20.616228 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.616827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.617803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:20.618664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:20.802594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:20.808896 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [a64e1975-4bd4-48c8-9c70-c609c01a8782] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 10:46:20.810040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-53471b62-932e-4fc5-9ee8-87a34382a0db tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.213869 Jul 18 10:46:20.811398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 239/470] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:20 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:21.064514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:21.065177 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:21.071096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.071531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.072333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.072780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.230997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:21.240552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b4051cf3-86e8-4811-abc8-13ede14922b3 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.180392 Jul 18 10:46:21.242167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 240/471] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:21 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:21.260322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-cc072126-66ea-4237-a41c-a0fa3e54b8ec req-35614b74-810c-41fe-84f2-28a7d0144706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a657a9-33a7-4766-8064-5084f549db71", "tag": "1611fb00-fc26-446c-8dfe-3b5162dc9845"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:21.276295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-cc072126-66ea-4237-a41c-a0fa3e54b8ec req-35614b74-810c-41fe-84f2-28a7d0144706 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.276808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-cc072126-66ea-4237-a41c-a0fa3e54b8ec req-35614b74-810c-41fe-84f2-28a7d0144706 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.290319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-cc072126-66ea-4237-a41c-a0fa3e54b8ec req-35614b74-810c-41fe-84f2-28a7d0144706 service nova] Creating event network-changed:1611fb00-fc26-446c-8dfe-3b5162dc9845 for instance a9a657a9-33a7-4766-8064-5084f549db71 on hv-cinder-84617 Jul 18 10:46:21.296042 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-cc072126-66ea-4237-a41c-a0fa3e54b8ec req-35614b74-810c-41fe-84f2-28a7d0144706 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039574 Jul 18 10:46:21.297078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 241/472] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:21.433835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:21.434728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:21.441959 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.442469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.443264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.443702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.581140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:21.589273 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b0feb8b8-b5c0-4e18-a5d0-516235b49b33 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1712 microversion: 2.1 time: 0.159840 Jul 18 10:46:21.589854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 242/473] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:21 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1712 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:21.817240 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [a64e1975-4bd4-48c8-9c70-c609c01a8782] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 39722. Jul 18 10:46:21.823132 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5251219f-4f59-44cd-a11f-bff02fbf2d8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/action" status: 202 len: 0 microversion: 2.20 time: 1.433597 Jul 18 10:46:21.829907 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 232/474] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Jul 18 10:46:20 2022] POST /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/action => generated 0 bytes in 1443 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:46:21.840299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:21.841970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:21.843457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:21.844125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:21.867334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.867903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.868945 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.870047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.870656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.871656 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:21.872526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:21.875752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:22.129544 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:22.131578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:22.139480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-53dd8ae3-d533-49e2-9c53-6b5a4ff4774c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.314934 Jul 18 10:46:22.141241 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 243/475] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:21 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:22.149656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:22.151390 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:22.152606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1808da66-1cdc-447b-a8ca-3ab919269b1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1749 microversion: 2.20 time: 0.321210 Jul 18 10:46:22.153193 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 233/476] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:21 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1749 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:22.259596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:22.260498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:22.267195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:22.267651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:22.268596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:22.269174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:22.416847 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:22.425170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-20f0034d-c762-46a9-8a74-ad54a5388849 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.170744 Jul 18 10:46:22.425743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 244/477] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:22 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:23.157905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:23.158717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:23.167514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.168389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.169974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.170872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.174035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:23.175738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:23.182197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.182903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.183815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.184489 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.405252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:23.409291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:23.414374 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:23.416198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:23.417417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-356ed030-d8b4-4777-8e1c-a5d559672f0d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.265062 Jul 18 10:46:23.417530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-872f2098-3d62-45ae-9563-b8eb456eae27 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1749 microversion: 2.20 time: 0.249876 Jul 18 10:46:23.417988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 234/478] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:23 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:23.427390 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 245/479] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:23 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:23.431440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-dd22c6e4-2ca8-4162-bc1a-b716dd6c1faa req-79b2448e-852e-4516-a16f-07beb2e2198d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a16e60a-09cc-47f1-afee-0dad5805fa1f", "tag": "1f6c4f11-48fc-4f90-b715-0854c41b8c15"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:23.440883 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-dd22c6e4-2ca8-4162-bc1a-b716dd6c1faa req-79b2448e-852e-4516-a16f-07beb2e2198d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.441373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-dd22c6e4-2ca8-4162-bc1a-b716dd6c1faa req-79b2448e-852e-4516-a16f-07beb2e2198d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.450641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:23.451844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:23.453029 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-dd22c6e4-2ca8-4162-bc1a-b716dd6c1faa req-79b2448e-852e-4516-a16f-07beb2e2198d service nova] Creating event network-changed:1f6c4f11-48fc-4f90-b715-0854c41b8c15 for instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f on hv-cinder-84617 Jul 18 10:46:23.459035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-dd22c6e4-2ca8-4162-bc1a-b716dd6c1faa req-79b2448e-852e-4516-a16f-07beb2e2198d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039949 Jul 18 10:46:23.460020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 235/480] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:23.463176 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.463914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.465274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:23.466132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:23.605647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:23.613481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-68a5251f-08cd-4455-a0bd-b7d766a2591d tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.173763 Jul 18 10:46:23.614044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 246/481] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:23 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:24.435423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:24.435946 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:24.436327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:24.436424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:24.438437 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:24.442960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.443200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.443454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.443675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.444227 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.444430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.444815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.444951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.643017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:24.650142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:24.651537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:24.653063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:24.654749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ebd296d3-7cd7-4d48-9dbe-361b165c3434 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1749 microversion: 2.20 time: 0.223014 Jul 18 10:46:24.655395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 247/482] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:24 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1749 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:24.658271 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-89cc8691-886a-4a08-96ee-9f580fcfaed0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.227205 Jul 18 10:46:24.658827 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 236/483] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:24 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:24.659725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:24.660320 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:24.666611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.667058 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.667817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:24.668252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:24.800159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:24.807576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c8e84e2e-7dfb-45ec-bd90-7427930cd237 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.151217 Jul 18 10:46:24.808143 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 248/484] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:24 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:25.673969 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:25.674487 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:25.675135 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:25.675745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:25.677099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:25.677590 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:25.678276 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=20 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:25.682023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.682461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:25.683024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.683228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.683469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:25.683667 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:25.684278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.684728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:25.881251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:25.885259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:25.890520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:25.892104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:25.893127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-48a43ad1-0780-4a51-9299-1a2dcc8a74d5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.221664 Jul 18 10:46:25.893489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7ebe4d6d-6bc9-4b1e-965d-94356b0fe094 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1749 microversion: 2.20 time: 0.224010 Jul 18 10:46:25.900769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 249/485] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:25 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:25.900922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 237/486] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:25 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1749 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:25.901007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:25.901007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:25.905438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.905888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:25.906650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:25.907093 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:26.034730 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:26.042028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-07f736a8-f125-490a-85b1-809d9bed760c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.146996 Jul 18 10:46:26.042972 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 250/487] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:25 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:26.909501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:26.910291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:26.916005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:26.916635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:26.916866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:26.917135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:26.917903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:26.918427 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:26.922943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:26.923488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:26.924249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:26.924774 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:27.119135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:27.128363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:27.128522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a1d042e0-b039-4b15-88a3-24a3059f92ef tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.222336 Jul 18 10:46:27.128934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 238/488] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:26 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:27.133661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:27.134256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:27.141165 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:27.141688 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:27.142443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:27.142887 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:27.146560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:27.148093 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:27.149287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e8c0d3bc-09b8-4ff7-acf4-8b7477f3248c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1749 microversion: 2.20 time: 0.237303 Jul 18 10:46:27.149840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 251/489] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:26 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1749 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:27.284020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:27.292057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28594984-acc0-41ff-9b09-b3f42ada08e1 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.161908 Jul 18 10:46:27.292640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 239/490] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:27 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:28.007161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-91446d17-99dc-4b28-99a7-6b815dda753a req-92b3d84c-1561-4b09-8b17-b62e016f8a4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9a657a9-33a7-4766-8064-5084f549db71", "name": "network-vif-plugged", "status": "completed", "tag": "1611fb00-fc26-446c-8dfe-3b5162dc9845"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:28.016565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-91446d17-99dc-4b28-99a7-6b815dda753a req-92b3d84c-1561-4b09-8b17-b62e016f8a4b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.017039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-91446d17-99dc-4b28-99a7-6b815dda753a req-92b3d84c-1561-4b09-8b17-b62e016f8a4b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.029716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-91446d17-99dc-4b28-99a7-6b815dda753a req-92b3d84c-1561-4b09-8b17-b62e016f8a4b service nova] Creating event network-vif-plugged:1611fb00-fc26-446c-8dfe-3b5162dc9845 for instance a9a657a9-33a7-4766-8064-5084f549db71 on hv-cinder-84617 Jul 18 10:46:28.034864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-91446d17-99dc-4b28-99a7-6b815dda753a req-92b3d84c-1561-4b09-8b17-b62e016f8a4b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031560 Jul 18 10:46:28.035453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 252/491] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:28.145620 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:28.146269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:28.152932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.153660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.155135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.155575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.167959 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:28.170166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:28.175628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:28.177645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.178090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.178945 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.179963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.370359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:28.375211 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:28.379562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8c9471a3-19c9-4040-b6ce-30227e44df78 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.237819 Jul 18 10:46:28.389064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 240/492] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:28 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:28.389220 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:28.389352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:28.389352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:28.389519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:28.389519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c7fdcc83-0706-4ed7-b33a-596fa6809e0c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1751 microversion: 2.20 time: 0.223079 Jul 18 10:46:28.389519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 253/493] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:28 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1751 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:28.392128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.392592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.393411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:28.393834 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:28.529175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:28.536957 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e5fd0c8a-6425-45c9-a59f-6eb0c4b122dd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.155854 Jul 18 10:46:28.537569 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 241/494] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:28 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:29.396660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:29.397288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:29.403274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.404311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.405040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.405218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:29.405618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.405827 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:29.411844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.412293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.413099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.413532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.602369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:29.606540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:29.609882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b5173f9d-737e-4ff4-93a7-6373ce1610b5 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.217272 Jul 18 10:46:29.610454 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 254/495] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:29 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:29.614807 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:29.615407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:29.623397 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:29.624090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.624544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.624923 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:29.625353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:29.625793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:29.626042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3536bd9f-dd94-4644-8173-9d824f37e901 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1751 microversion: 2.20 time: 0.225183 Jul 18 10:46:29.626588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 242/496] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:29 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1751 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:29.628505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:29.754028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:29.761343 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f9f08ee1-d99f-4ac4-9f2f-dd22addb8268 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.149952 Jul 18 10:46:29.761905 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 255/497] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:29 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:30.627353 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:30.627967 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:30.634596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.635044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:30.635911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.636346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:30.644485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:30.646861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:30.651150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.652796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:30.652796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.652796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:30.846466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:30.850440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:30.853856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-915b081e-c9cb-4d2b-b5ee-201aff466c42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.230480 Jul 18 10:46:30.854418 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 243/498] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:30 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:30.858792 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:30.859235 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:30.859369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:30.860736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:30.862054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-197f3827-6e96-4fc2-beec-46b60ad95ce6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1751 microversion: 2.20 time: 0.221469 Jul 18 10:46:30.862624 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 256/499] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:30 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1751 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:30.865238 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.865688 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:30.866442 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:30.866873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:31.001355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:31.009103 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-475f0978-83ad-4926-8839-ff8728e17313 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.153675 Jul 18 10:46:31.009741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 244/500] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:30 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:31.870674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:31.871309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:31.878056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:31.878493 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:31.879268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:31.879691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:31.881154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:31.881871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:31.888922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:31.890817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:31.890817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:31.890817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:32.081484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:32.089550 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:32.091198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:32.092672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c1dffdb1-a9c7-46c1-a1ba-ba697825513f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1751 microversion: 2.20 time: 0.215604 Jul 18 10:46:32.100777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:32.104801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b095bdd1-f9fb-4877-be92-c653edcccfdd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1366 microversion: 2.1 time: 0.238048 Jul 18 10:46:32.106278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 257/501] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:31 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:32.107868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 245/502] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:31 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:32.117651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:32.118255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:32.124893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:32.125335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:32.126086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:32.126511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:32.265703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:32.273417 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a14b45f0-9e96-4fc8-9973-d11bf88e8557 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.159586 Jul 18 10:46:32.273861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 258/503] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:32 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:33.112351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:33.113115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:33.123150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:33.130933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:33.131404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.131404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.131404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.131404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.131692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.131692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.132494 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.133114 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.334906 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:33.341663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:33.349319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:33.349319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:33.349319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5d3cbc63-38f9-4e1c-864d-6a3256ebe1ef tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.239842 Jul 18 10:46:33.349762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 246/504] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:33 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:33.349888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-84c49c09-9d69-4703-a3b1-c4f3fdb41c04 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1555 microversion: 2.1 time: 0.230580 Jul 18 10:46:33.361877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:33.361877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:33.361877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.362836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.363002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.363254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 259/505] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:33 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:33.363434 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.368199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:33.368716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:33.375416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.375862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.376853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.377292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.483982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5c0b9973-3f72-4312-b9d8-006175a09701 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119547 Jul 18 10:46:33.484573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 260/506] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:46:33 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:33.673889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:33.681901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4d044619-3990-4682-b311-b1a72ca9414b tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.332395 Jul 18 10:46:33.683587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 247/507] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:33 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:33.864639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-486b3d72-e46b-44b6-9004-02e6ffe7c221 req-4a37ec7e-93d1-4e03-9dbc-dff57a455c75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a16e60a-09cc-47f1-afee-0dad5805fa1f", "name": "network-vif-plugged", "status": "completed", "tag": "1f6c4f11-48fc-4f90-b715-0854c41b8c15"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:33.873618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-486b3d72-e46b-44b6-9004-02e6ffe7c221 req-4a37ec7e-93d1-4e03-9dbc-dff57a455c75 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:33.874062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-486b3d72-e46b-44b6-9004-02e6ffe7c221 req-4a37ec7e-93d1-4e03-9dbc-dff57a455c75 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:33.885713 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-486b3d72-e46b-44b6-9004-02e6ffe7c221 req-4a37ec7e-93d1-4e03-9dbc-dff57a455c75 service nova] Creating event network-vif-plugged:1f6c4f11-48fc-4f90-b715-0854c41b8c15 for instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f on hv-cinder-84617 Jul 18 10:46:33.891567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-486b3d72-e46b-44b6-9004-02e6ffe7c221 req-4a37ec7e-93d1-4e03-9dbc-dff57a455c75 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Jul 18 10:46:33.892395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 261/508] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:34.369933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:34.370464 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:34.377341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:34.384735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:34.384735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:34.384735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:34.612052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:34.621728 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:34.623703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:34.624892 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cd12b1ce-5435-4a1b-b9f6-69cf3b0b8027 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.259033 Jul 18 10:46:34.625446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 248/509] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:34 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:34.699466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:34.700257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:34.708938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:34.709524 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:34.710608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:34.711045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:34.937792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:34.953223 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dee2dc32-7125-426d-b051-b4ed87b26edd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.257527 Jul 18 10:46:34.967504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 262/510] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:34 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:35.115164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-e6abb5bb-d2ff-4fd4-8ce5-3f1eb5f520a9 req-4050fe9f-6553-4035-beb6-29dd3e1cd966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9a657a9-33a7-4766-8064-5084f549db71", "tag": "1611fb00-fc26-446c-8dfe-3b5162dc9845"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:35.124278 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-e6abb5bb-d2ff-4fd4-8ce5-3f1eb5f520a9 req-4050fe9f-6553-4035-beb6-29dd3e1cd966 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:35.125063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-e6abb5bb-d2ff-4fd4-8ce5-3f1eb5f520a9 req-4050fe9f-6553-4035-beb6-29dd3e1cd966 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:35.146501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-e6abb5bb-d2ff-4fd4-8ce5-3f1eb5f520a9 req-4050fe9f-6553-4035-beb6-29dd3e1cd966 service nova] Creating event network-changed:1611fb00-fc26-446c-8dfe-3b5162dc9845 for instance a9a657a9-33a7-4766-8064-5084f549db71 on hv-cinder-84617 Jul 18 10:46:35.154257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-e6abb5bb-d2ff-4fd4-8ce5-3f1eb5f520a9 req-4050fe9f-6553-4035-beb6-29dd3e1cd966 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041518 Jul 18 10:46:35.155675 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 249/511] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:35.645678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:35.648712 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:35.669277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:35.678353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:35.678353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:35.678353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:35.867443 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:35.881229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:35.884902 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:35.886111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3c8b79ea-9e77-4f58-b977-d1dd3fc835c2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.245602 Jul 18 10:46:35.886883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 263/512] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:35 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:35.974737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:35.975172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:35.981877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:35.982680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:35.983642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:35.984073 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:36.160649 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:36.173082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a2798bde-bc11-4a2e-82ab-63383606cc55 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.203711 Jul 18 10:46:36.173802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 250/513] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:35 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:36.906289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:36.937066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:36.937066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:36.937066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:36.937066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:36.937555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:37.074304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:37.084207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:37.086206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:37.087377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2f49ec07-d465-442f-b0f4-f63052dd6359 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.185840 Jul 18 10:46:37.092737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 264/514] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:36 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:37.192631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:37.193241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:37.199974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:37.200420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:37.201221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:37.201686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:37.371621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:37.382587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f69d06a6-9529-4a53-97df-9f8028e89074 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.194951 Jul 18 10:46:37.385315 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 251/515] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:37 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:38.106620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:38.107696 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:38.119680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:38.119680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:38.119680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:38.119680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:38.264170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:38.275158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:38.276760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:38.278302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-55333e89-4640-487b-a721-f013a394d680 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.175529 Jul 18 10:46:38.301606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 265/516] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:38 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:38.400110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:38.401401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:38.410006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:38.410706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:38.411706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:38.412515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:38.609598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:38.617478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4114a5f6-a594-4b34-b5ab-556df1066831 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.221872 Jul 18 10:46:38.618098 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 252/517] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:38 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:39.303731 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:39.304355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:39.311155 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:39.311601 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:39.312377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:39.312839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:39.479051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:39.489013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:39.490514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:39.491663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5e98d807-694b-4f51-9a07-9b918655e0bc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.192150 Jul 18 10:46:39.492210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 266/518] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:39 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:39.635861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:39.637280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:39.644490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:39.645052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:39.646090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:39.646523 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:39.789327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:39.798097 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c31ef4f3-97fd-43d4-a1d9-336189b3a7b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.166537 Jul 18 10:46:39.798998 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 253/519] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:39 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:39.827121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:46:39.827327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Mon Jul 18 10:46:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:46:40.510071 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:40.510670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:40.517716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:40.518150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:40.522973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:40.522973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:40.674630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:40.684021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:40.688190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:40.689599 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ac66259-c045-48d5-86a3-5d6c69c0545a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.183353 Jul 18 10:46:40.690156 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 267/520] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:40 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:40.815967 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:40.816506 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:40.828618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:40.829634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:40.830853 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:40.831285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:40.981106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:40.990181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-413f376e-e455-4fb7-8f26-1317b3327b17 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.178167 Jul 18 10:46:40.990751 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 254/521] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:40 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:41.707598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:41.708215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:41.714469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:41.714920 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:41.715815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:41.716840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:41.851581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:41.860862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:41.862663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:41.864091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ed53cf97-2874-4c5c-ab08-10e57c8127df tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.160633 Jul 18 10:46:41.864666 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 268/522] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:41 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:42.007493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:42.008239 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:42.016035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:42.016582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:42.017681 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:42.018253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:42.193357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:42.203530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-35d2f8fd-daa0-4364-9142-1209b9c249bd tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.199925 Jul 18 10:46:42.206316 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 255/523] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:42 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:42.883701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:42.885181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:42.892429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:42.892919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:42.893871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:42.894451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:43.032332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:43.042413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:43.044052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:43.045906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-66c37a18-8fbd-4fa9-b15c-e537f6082dde tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.166037 Jul 18 10:46:43.052396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 269/524] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:42 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:43.221973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:43.222613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:43.229647 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:43.230032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:43.230822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:43.231426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:43.373131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:43.381721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7674a7fb-88ec-4610-8a07-7f88870111b8 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.163492 Jul 18 10:46:43.382412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 256/525] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:43 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:44.067284 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:44.068045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:44.074396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:44.075043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:44.075877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:44.076323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:44.218437 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:44.227190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:44.228723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:44.230207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-36c8781d-f1f1-4e7c-b252-ba6e48ee6bd4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.167037 Jul 18 10:46:44.230459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 270/526] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:44 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:44.398674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:44.399577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:44.406635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:44.407138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:44.413253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:44.413253 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:44.544006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:44.547911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:44.552704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-adb8e495-e80a-4e0e-a2fc-3836f2599744 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.158138 Jul 18 10:46:44.553382 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 257/527] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:44 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:45.248837 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:45.249485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:45.255964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.256404 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.257319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.257757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.316086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "237170ae-2ea8-4dd7-bc44-2316ef5112d2"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:45.317294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:45.323383 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.323835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.324634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.325739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.398916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:45.411370 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:45.413048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:45.414290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-924f6d08-facf-4038-8306-006f7658eb4a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.169647 Jul 18 10:46:45.414919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 271/528] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:45 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:45.569480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:45.570086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:45.576854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.577243 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.578029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:45.578485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:45.709906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:45.712166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:45.719006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bbaa0388-e972-48d3-8754-448807564abf tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1319 microversion: 2.1 time: 0.153287 Jul 18 10:46:45.719577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 272/529] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:45 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:46:46.433445 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:46.434157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:46.440650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.441132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:46.441897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.442399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:46.577108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:46.586031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:46.590998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:46.590998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8eb682cb-bab1-4440-a890-ce18041bb5ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.159484 Jul 18 10:46:46.590998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 273/530] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:46 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:46:46.737077 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:46.737690 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:46.743802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.744197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:46.744977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.745400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:46.906002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:46.913601 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1a3c6459-917c-49e7-803c-508ddc0d8660 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1508 microversion: 2.1 time: 0.180548 Jul 18 10:46:46.914161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 274/531] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:46 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:46.933484 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5abf76e3-4d7e-4628-ab12-be1e6306b2f0", "device": "/dev/sdb"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:46.935094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:46.941045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.941495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:46.942254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:46.942688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:47.736315 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5ac89b87-1687-49ea-9a3e-4f6f81812bbf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.424433 Jul 18 10:46:47.737017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 258/532] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:46:45 2022] POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments => generated 194 bytes in 2426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:46:47.742333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:47.743014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:47.749683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:47.750166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:47.750936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:47.751368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:47.899312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:47.908979 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:47.910485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:47.911643 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7fc984b2-8fa3-443f-ac2d-e698dfb139e7 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.173542 Jul 18 10:46:47.912414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 259/533] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:47 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:47.930073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3b8974b6-5e11-4b6e-8c4a-ff580ea49495 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "POST /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.000157 Jul 18 10:46:47.930687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 275/534] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:46:46 2022] POST /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f/os-volume_attachments => generated 194 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:46:48.932024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:48.932962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:48.939784 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:48.940225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:48.941014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:48.941444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:49.081843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:49.091866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:49.093463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:49.094622 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2dc71636-4361-4741-be6a-0a4263d2fec5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.167100 Jul 18 10:46:49.095182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 260/535] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:48 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:50.114236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:50.115063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:50.121831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:50.122525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:50.123301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:50.123736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:50.260199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:50.269540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:50.270713 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:50.271864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-062f019a-9225-403b-beb1-70a2e27d0f73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.162354 Jul 18 10:46:50.272416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 276/536] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:50 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:51.290405 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:51.291004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:51.298262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:51.298705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:51.299451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:51.299875 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:51.433066 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:51.442492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:51.444023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:51.445205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7c7ef328-8115-4ad4-a710-8a58ebac43e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.158660 Jul 18 10:46:51.445755 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 261/537] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:51 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:52.463488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:52.464095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:52.471059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:52.471509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:52.472274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:52.472833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:52.599306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:52.608280 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:52.609947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:52.611100 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-03c02144-84b5-47f7-a11f-357500ee3770 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.151485 Jul 18 10:46:52.611657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 277/538] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:52 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:53.629801 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:53.630330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:53.637723 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:53.638175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:53.638930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:53.639359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:53.771263 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:53.779641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:53.781153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:53.782289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8952e9a9-b085-4deb-839e-4018f526e1ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.156478 Jul 18 10:46:53.782837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 262/539] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:53 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:54.800424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:54.801054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:54.803430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=62 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:54.808247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:54.813843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:54.813843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:54.813843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:54.940670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:54.948957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:54.950619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:54.951778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bde4f3ea-0c55-45a6-9011-5baa2cb4446c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.155277 Jul 18 10:46:54.952321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 278/540] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:54 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:55.970506 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:55.971117 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:55.973667 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=52 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:46:55.978340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:55.983187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:55.983187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:55.983187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:56.113533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:56.121872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:56.123370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:56.124516 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b4d1293b-a030-4d07-9445-72633504fe37 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.157868 Jul 18 10:46:56.125125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 263/541] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:55 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:56.285043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:56.286288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:56.292913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:56.293954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:56.294927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:56.295368 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:56.319298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'flavor' on Instance uuid 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:46:56.768197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3454dcda-7884-4c62-8a43-a766a773106a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/action" status: 200 len: 32 microversion: 2.1 time: 0.487784 Jul 18 10:46:56.769043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 279/542] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:46:56 2022] POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/action => generated 32 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:46:56.778602 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:56.779144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:56.785140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:56.785588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:56.786347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:56.786775 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:56.918532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:56.926599 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5051294e-1667-4c31-9aa5-83ae8686ff19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.152626 Jul 18 10:46:56.927160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 264/543] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:56 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:57.143774 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:57.144476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:57.150814 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:57.151265 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:57.152035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:57.152506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:57.285352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:57.294790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:57.296623 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:57.297804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-92398fe5-569b-4325-9df3-7929c46eaab9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.158607 Jul 18 10:46:57.298403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 280/544] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:57 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:57.843568 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-91b615e6-8709-4f83-86ce-270e488de568 req-46f60929-752b-4659-ae20-ae266f5adfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "name": "network-vif-plugged", "status": "completed", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:46:57.851871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-91b615e6-8709-4f83-86ce-270e488de568 req-46f60929-752b-4659-ae20-ae266f5adfa4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:57.852310 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-91b615e6-8709-4f83-86ce-270e488de568 req-46f60929-752b-4659-ae20-ae266f5adfa4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:57.863807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-91b615e6-8709-4f83-86ce-270e488de568 req-46f60929-752b-4659-ae20-ae266f5adfa4 service nova] Creating event network-vif-plugged:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:46:57.868484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-91b615e6-8709-4f83-86ce-270e488de568 req-46f60929-752b-4659-ae20-ae266f5adfa4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030237 Jul 18 10:46:57.869087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 265/545] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:46:57.943729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:57.944263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:57.951026 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:57.951469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:57.952213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:57.952637 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:58.087851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:58.096188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a1cdf312-27a9-4593-af79-fee0686bb5d8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.156353 Jul 18 10:46:58.096789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 281/546] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:57 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:58.316603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:58.317328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:58.323484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:58.323943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:58.324870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:58.325319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:58.457578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:58.475747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:58.475747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:58.475747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c9a44ed5-336a-4b86-89af-7c3305820bf2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.158386 Jul 18 10:46:58.476141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 266/547] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:58 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:46:59.113721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:59.114267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:59.120810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:59.121822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:59.122582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:59.123013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:59.255515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:59.265063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-789f6391-5742-4f64-be9c-e06fbb1d3972 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.155139 Jul 18 10:46:59.265709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 282/548] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:46:59 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:46:59.492695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:46:59.493388 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:46:59.500955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:59.501407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:59.502167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:46:59.502602 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:46:59.641287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:59.649557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:59.651037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:46:59.652173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-91454452-d2a4-4dd5-93ce-e2c1f7a4d352 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.163392 Jul 18 10:46:59.652781 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 267/549] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:46:59 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:00.283147 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:00.283764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:00.290386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:00.290841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:00.291598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:00.292065 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:00.421181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:00.429352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d9cb4e18-dabe-4ce8-b10d-01a675547889 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.150123 Jul 18 10:47:00.429914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 283/550] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:00 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:00.673475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:00.674082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:00.680547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:00.681023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:00.681775 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:00.682206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:00.813862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:00.822345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:00.823846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:00.825046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-527594c7-a57e-447a-bf5b-c91bcf49d25f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.155381 Jul 18 10:47:00.825599 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 268/551] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:00 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:47:01.447146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:01.448084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:01.454072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:01.454833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:01.455599 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:01.456083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:01.584214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:01.592805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-38cd3aa9-e2f3-4734-aa59-be22d49750bf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.149723 Jul 18 10:47:01.593361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 284/552] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:01 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:01.843382 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:01.843999 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:01.850756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:01.851210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:01.851995 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:01.852416 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:01.991214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:02.000233 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:02.001761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:02.002931 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-33d68175-a107-47da-8fbf-24ebb9a04da3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.163516 Jul 18 10:47:02.003493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 269/553] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:01 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:02.610252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:02.658457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:02.658457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:02.658457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:02.658457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:02.658890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:02.750914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:02.758711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d0652b1a-5ec5-4f56-a953-b924d79b624a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.152502 Jul 18 10:47:02.759270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 285/554] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:02 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:03.021419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:03.022022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:03.028993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:03.034929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:03.034929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:03.034929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:03.161867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:03.170864 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:03.172349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:03.173514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-90f2e7e0-1271-4f5d-81ac-a48424995b09 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1807 microversion: 2.20 time: 0.156117 Jul 18 10:47:03.174067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 270/555] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:03 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:03.775146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:03.775777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:03.782764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:03.783213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:03.784053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:03.784492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:03.788777 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:03.924372 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:03.932208 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0b3c7a2f-6aa3-4001-b610-e2b6b5dd6d17 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.160879 Jul 18 10:47:03.932776 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 286/556] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:03 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:04.191963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:04.192574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:04.198869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:04.199970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:04.200815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:04.201252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:04.332745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:04.345214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:04.353338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:04.353338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e79abed4-0b20-4dcc-8b85-a9a72169f4fb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1794 microversion: 2.20 time: 0.159777 Jul 18 10:47:04.353338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 271/557] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:04 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1794 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:04.949762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:04.950376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:04.957663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:04.958115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:04.958881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:04.959319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:05.097881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:05.106551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5d819d43-6237-43d9-adf0-2e6e88a2ad15 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.161207 Jul 18 10:47:05.107111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 287/558] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:04 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:06.123318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:06.123928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:06.130606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:06.131064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:06.131937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:06.132378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:06.284538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:06.294289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ac61438c-6a26-4195-837f-491de34192be tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.174910 Jul 18 10:47:06.295143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 272/559] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:06 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:07.311854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:07.312491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:07.318988 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:07.319429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:07.320179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:07.320604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:07.451376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:07.459911 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2d852587-a2b7-4e42-9473-c95c73d7ef99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.152475 Jul 18 10:47:07.460471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 288/560] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:07 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:08.477938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:08.478548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:08.485961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:08.486408 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:08.487167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:08.487598 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:08.620309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:08.623904 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:08.629861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2e00b9b6-fc4b-41b9-98a7-93550849f8c7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.154571 Jul 18 10:47:08.629861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 273/561] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:08 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:09.645591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:09.646181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:09.653428 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:09.653876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:09.654634 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:09.655071 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:09.784248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:09.792126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c2971a13-a876-41cc-81ab-981adf6450a5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.150413 Jul 18 10:47:09.794782 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 289/562] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:09 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:10.123144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-36282933", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:10.173748 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] validate_networks() for None {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:10.674633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:10.675057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:10.675570 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:10.675978 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:10.676389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:10.686640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:10.687087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:10.687881 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:10.688313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:10.705478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Getting quotas for project 97b79ca700b4425ca0c6aa8a346e7eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:10.709391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Getting quotas for user 686a36a7925f4a4c95d821c644628dfb and project 97b79ca700b4425ca0c6aa8a346e7eeb. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:10.720286 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:10.722712 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:10.809449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:10.810080 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:10.816664 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:10.817161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:10.817922 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:10.818352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:10.905163 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fb210a14-6729-42f9-8d11-d9509220e661 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.786382 Jul 18 10:47:10.906106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 274/563] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:10.915900 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f56b6ea8-779f-41c5-9a44-17f1d364631b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:10.916513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f56b6ea8-779f-41c5-9a44-17f1d364631b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:10.958942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:10.967414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7e932838-a10d-4692-a4b8-858ba88bfccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.162534 Jul 18 10:47:10.968191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 290/564] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:10 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:10.977992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f56b6ea8-779f-41c5-9a44-17f1d364631b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:10.985329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f56b6ea8-779f-41c5-9a44-17f1d364631b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1213 microversion: 2.1 time: 0.073311 Jul 18 10:47:10.986171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 275/565] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:10 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:11.984968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:11.985575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:11.992073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:11.992521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:11.993315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:11.993753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:12.004713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c120d9ac-637c-4775-882a-e86fea2ce2b4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:12.011212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c120d9ac-637c-4775-882a-e86fea2ce2b4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:12.085075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c120d9ac-637c-4775-882a-e86fea2ce2b4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:12.092126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c120d9ac-637c-4775-882a-e86fea2ce2b4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1213 microversion: 2.1 time: 0.091281 Jul 18 10:47:12.092705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 276/566] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:11 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:12.150274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:12.158573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c2e9db39-2483-4139-9bf3-ccd1aced40b7 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.177454 Jul 18 10:47:12.159144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 291/567] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:11 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:13.108848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:13.109483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:13.116020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.116469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.117249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.117680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.175229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:13.176287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:13.178087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:13.182452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.182894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.184293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.184749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.186196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c7f5946d-8f9d-4f6a-8af6-dcf24ab827be tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1217 microversion: 2.1 time: 0.081726 Jul 18 10:47:13.186761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 277/568] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:13 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:13.317223 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:13.325347 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-142097c8-d042-47a8-a702-08dc0a38ba6a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.153927 Jul 18 10:47:13.325928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 292/569] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:13 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:13.711062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:13.711549 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:13.718361 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.718809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.719580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:13.720016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:13.847935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lazy-loading 'services' on Instance uuid f01418be-d04a-4364-94f0-5c85f9244d63 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:14.182270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3dd10cbf-879d-4b22-a1c6-7a032d786aeb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments/150059ed-fec9-4c01-9a54-99d0f564d360" status: 202 len: 0 microversion: 2.1 time: 0.474943 Jul 18 10:47:14.183020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 278/570] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:47:13 2022] DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments/150059ed-fec9-4c01-9a54-99d0f564d360 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:14.203151 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:14.204695 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:14.211098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:14.213667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:14.213667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:14.213667 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:14.276086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:14.284384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fc7007f0-c263-429b-9f5a-35dbcc71b4b0 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1265 microversion: 2.1 time: 0.085246 Jul 18 10:47:14.284985 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 293/571] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:14 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1265 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:14.344422 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:14.345108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:14.354756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:14.361087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:14.361087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:14.361087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:14.488730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:14.497679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6d52f43b-6dc4-46ee-8c86-5e962990d95a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.158197 Jul 18 10:47:14.498269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 279/572] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:14 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:15.305967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:15.306592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:15.314032 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:15.314838 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:15.315606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:15.316039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:15.396524 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:15.406590 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4c8b3ca8-ce39-4d24-af59-15147be71d58 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1273 microversion: 2.1 time: 0.104443 Jul 18 10:47:15.407160 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 294/573] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:15 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:15.514823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:15.515433 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:15.521886 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:15.522332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:15.523083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:15.524425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:15.672720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:15.680961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bab69c56-ed70-4b43-9856-9f4d4457f0e9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.170138 Jul 18 10:47:15.681523 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 280/574] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:15 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:16.361471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-793de67e-982d-4f6b-bfec-5ffde253d006 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:16.367306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-793de67e-982d-4f6b-bfec-5ffde253d006 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.367772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-793de67e-982d-4f6b-bfec-5ffde253d006 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.392178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-793de67e-982d-4f6b-bfec-5ffde253d006 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Going to try to stop instance {{(pid=124843) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 10:47:16.424124 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:16.426428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:16.431448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.431856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.434105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.434850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.598609 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:16.612526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0f625501-fa5b-4e23-bd49-c4907610585d tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.192215 Jul 18 10:47:16.613149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 281/575] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:16 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:16.630055 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-793de67e-982d-4f6b-bfec-5ffde253d006 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action" status: 202 len: 0 microversion: 2.1 time: 0.273287 Jul 18 10:47:16.630715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 295/576] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:47:16 2022] POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:47:16.640064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:16.641019 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:16.648003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.648447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.649285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.649882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.698893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:16.700162 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:16.707011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.707468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.708358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:16.708885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:16.875240 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:16.882949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c8343470-8faf-4089-bab6-18043af35115 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.246774 Jul 18 10:47:16.883536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 282/577] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:16 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:16.907576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:16.915687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c634d601-2a3f-44f0-a3d4-69c99de7967a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.221148 Jul 18 10:47:16.916307 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 296/578] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:16 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:17.286133 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-9d05eba8-5809-4762-b81a-9b5f42962900 req-0203eca1-5f5f-4f7f-bad3-53f5baaa6c9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c777c9f-638b-4453-8910-368eaa5654c1", "tag": "35f5a63a-eaea-402c-ad49-fe72ae0a81ef"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:17.297025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9d05eba8-5809-4762-b81a-9b5f42962900 req-0203eca1-5f5f-4f7f-bad3-53f5baaa6c9c service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.300697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9d05eba8-5809-4762-b81a-9b5f42962900 req-0203eca1-5f5f-4f7f-bad3-53f5baaa6c9c service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.313651 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-9d05eba8-5809-4762-b81a-9b5f42962900 req-0203eca1-5f5f-4f7f-bad3-53f5baaa6c9c service nova] Creating event network-changed:35f5a63a-eaea-402c-ad49-fe72ae0a81ef for instance 7c777c9f-638b-4453-8910-368eaa5654c1 on hv-cinder-84617 Jul 18 10:47:17.318974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-9d05eba8-5809-4762-b81a-9b5f42962900 req-0203eca1-5f5f-4f7f-bad3-53f5baaa6c9c service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037205 Jul 18 10:47:17.319583 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 283/579] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:17.630299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:17.630867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:17.637516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.637968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.638761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.639199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.774921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:17.783002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4e396f38-67ba-4bf5-af63-7e89171ed95a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.156556 Jul 18 10:47:17.783566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 297/580] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:17 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:17.831652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:17.832335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:17.839876 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.840329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.841128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.841567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.900820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:17.901479 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:17.908108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.908788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.909640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:17.910075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:17.925355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lazy-loading 'services' on Instance uuid 8a16e60a-09cc-47f1-afee-0dad5805fa1f {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:18.045993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:18.053367 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-885c683e-8e2b-4931-be68-2ea959483c74 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.156360 Jul 18 10:47:18.053925 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 298/581] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:17 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:18.058444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:18.059049 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:18.064580 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:18.065054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:18.065811 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:18.066263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:18.197662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:18.206697 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-38805a45-ed04-4d62-a569-93d3acb0d30d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.151813 Jul 18 10:47:18.207326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 299/582] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:18 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:18.225053 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dc834f60-cd1d-4e44-bcea-0b77f911364c tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f/os-volume_attachments/5abf76e3-4d7e-4628-ab12-be1e6306b2f0" status: 202 len: 0 microversion: 2.1 time: 0.398279 Jul 18 10:47:18.225632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 284/583] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:47:17 2022] DELETE /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f/os-volume_attachments/5abf76e3-4d7e-4628-ab12-be1e6306b2f0 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:18.800820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:18.801429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:18.808417 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:18.808938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:18.809678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:18.810109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:18.939942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:18.947401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9e70be59-83f1-4f68-860c-ecb6055439ed tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.150576 Jul 18 10:47:18.947960 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 300/584] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:18 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:19.071414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:19.072230 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:19.078424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.078873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:19.079899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.080334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:19.209506 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:19.217035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f877465b-d5de-4c05-9b34-c85fdf0b7efb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.150224 Jul 18 10:47:19.217607 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 285/585] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:19 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:19.223105 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:19.223715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:19.230214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.231003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:19.232140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.232805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:19.367195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:19.369127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:19.375700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-edba8d18-c969-4c9f-a485-0a5c8eeb1a3d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.156390 Jul 18 10:47:19.376259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 301/586] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:19 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:19.965281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:19.965897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:19.971884 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.972331 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:19.973119 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:19.973558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:20.110346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:20.117800 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ec026b0-215d-419c-8175-250c4e3b2547 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.156477 Jul 18 10:47:20.118364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 286/587] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:19 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:20.234829 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:20.235465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:20.242552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:20.245630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:20.245630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:20.245630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:20.380531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:20.388215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-042ad284-7929-4b4c-ba56-4252615593ff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.157216 Jul 18 10:47:20.391463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 302/588] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:20 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:20.393015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:20.393895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:20.399888 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:20.400335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:20.401132 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:20.402064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:20.529584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:20.537394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-08c5b5a7-c6ee-47f5-b5ee-e77525707b8d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.148223 Jul 18 10:47:20.537951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 287/589] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:20 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:21.134563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:21.135225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:21.142300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.143570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.143570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.143901 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.280600 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:21.288001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d3a5672f-52d9-479a-a16d-04872e9dfb7f tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.157677 Jul 18 10:47:21.288563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 303/590] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:21 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:21.407123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:21.407734 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:21.409697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:21.414902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.425369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.425369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.425369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.554573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:21.554867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:21.555184 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:21.562086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.562534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.563139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9c278be9-3111-4889-91d8-7b4abd5ef1b3 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.159994 Jul 18 10:47:21.563297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:21.563705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 288/591] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:21 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:21.563815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:21.698532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:21.706878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91234105-02b2-44cc-ab08-4e7c5e966ec0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.156213 Jul 18 10:47:21.707444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 304/592] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:21 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:22.305603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:22.306214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:22.308050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:22.312955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.313409 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.314212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.314649 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.451903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:22.460138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f7f76606-525f-4398-8fbc-136574a452e3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.158312 Jul 18 10:47:22.460741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 289/593] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:22 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:22.511780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:22.512461 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:22.519263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.519706 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.520503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.521003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.546213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:47:22.581990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:22.583026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:22.590530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.590903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.591666 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.592475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.722346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:22.730496 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-86569df2-de02-4315-a68d-bef4a4b1ca87 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.153340 Jul 18 10:47:22.731160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 290/594] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:22 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:22.735590 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:22.736185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:22.741813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.742269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.743009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.743454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.876993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3df59dda-f25f-4cd4-930e-b4bfa7631e07 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "DELETE /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 204 len: 0 microversion: 2.1 time: 0.369429 Jul 18 10:47:22.877639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 305/595] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:47:22 2022] DELETE /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:47:22.881557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:22.886455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:22.887206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:22.889652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8331015c-c26d-42cd-9257-11895b1ea384 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.157454 Jul 18 10:47:22.890150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 291/596] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:22 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:22.898128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.898128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:22.898128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:22.898128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.033340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:23.041016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c4c43a44-7c4b-45cd-86de-6bb9c4683880 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1514 microversion: 2.1 time: 0.158952 Jul 18 10:47:23.041580 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 306/597] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:22 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:23.477360 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:23.477965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:23.485529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.485977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.486740 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.487176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.506432 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:23.621211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:23.628645 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-993b38c1-3d48-4bb7-a023-cb08af6f6877 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.155137 Jul 18 10:47:23.629288 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 292/598] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:23 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:23.748362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:23.748991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:23.755471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.755916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.756660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.757110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.897921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:23.906533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec514c19-8ec5-4cd8-bce8-1e485d7d4bbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.161927 Jul 18 10:47:23.907356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 307/599] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:23 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:23.914277 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:23.915158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:23.924333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.925243 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:23.926653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:23.927243 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.009890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-1eb6ecc5-b833-461a-ae1b-5fe10880ce09 req-c4ec5955-f7eb-400f-b533-6c9303f00266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c777c9f-638b-4453-8910-368eaa5654c1", "name": "network-vif-plugged", "status": "completed", "tag": "35f5a63a-eaea-402c-ad49-fe72ae0a81ef"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:24.018453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1eb6ecc5-b833-461a-ae1b-5fe10880ce09 req-c4ec5955-f7eb-400f-b533-6c9303f00266 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.018810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1eb6ecc5-b833-461a-ae1b-5fe10880ce09 req-c4ec5955-f7eb-400f-b533-6c9303f00266 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.030457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-1eb6ecc5-b833-461a-ae1b-5fe10880ce09 req-c4ec5955-f7eb-400f-b533-6c9303f00266 service nova] Creating event network-vif-plugged:35f5a63a-eaea-402c-ad49-fe72ae0a81ef for instance 7c777c9f-638b-4453-8910-368eaa5654c1 on hv-cinder-84617 Jul 18 10:47:24.035253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-1eb6ecc5-b833-461a-ae1b-5fe10880ce09 req-c4ec5955-f7eb-400f-b533-6c9303f00266 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029006 Jul 18 10:47:24.036015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 308/600] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:24.059178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:24.059877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:24.066445 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.066895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.072834 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.072962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:24.073096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.076187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6999b8d9-835f-4479-9d37-f7fd09eb211f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.165992 Jul 18 10:47:24.076836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 293/601] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:23 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:24.205514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:24.212953 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-25e6bd5f-5994-4f09-85f7-151601c727c9 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1514 microversion: 2.1 time: 0.158040 Jul 18 10:47:24.216769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 309/602] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:24 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:24.646065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:24.646672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:24.654063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.654510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.655262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.655692 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.787535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:24.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ab54271-be83-4d0e-b288-a5bb0aa55cc1 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.153326 Jul 18 10:47:24.796085 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 294/603] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:24 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:24.923956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:24.924474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:24.926887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:24.931563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.932008 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:24.932812 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:24.933253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.071406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:25.080708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3f67fcc4-0fb0-4ccf-9864-f0141d9ab99d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.160654 Jul 18 10:47:25.081280 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 310/604] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:24 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:25.093212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:25.093817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:25.099656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.100104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.100914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.101351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.232490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:25.233164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:25.239255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.239706 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.240472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.240942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.245214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:25.254112 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4f44895b-cda6-4312-b642-d0df33dc9b00 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1737 microversion: 2.1 time: 0.165236 Jul 18 10:47:25.254997 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 295/605] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:25 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:25.373361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:25.380764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d6c437ad-02eb-4a70-85a3-ada3c89fdafa tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1514 microversion: 2.1 time: 0.153898 Jul 18 10:47:25.381391 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 311/606] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:25 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:25.813277 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:25.813891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:25.820610 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.821096 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.822207 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:25.822329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:25.957914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:25.965522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d6ccb775-3383-44bb-a623-06190d587814 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.156154 Jul 18 10:47:25.966092 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 296/607] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:25 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:26.098369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.099032 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.106250 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.106699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.107459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.107898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.241342 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:26.246955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-a5818d51-87fe-4777-b34d-e083984ab268 req-83919bbd-9d94-401a-a743-b1eb09e377e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a16e60a-09cc-47f1-afee-0dad5805fa1f", "name": "network-vif-deleted", "tag": "1f6c4f11-48fc-4f90-b715-0854c41b8c15"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:26.249849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec701d55-327c-4b3a-8d82-041e2022e22f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.155227 Jul 18 10:47:26.251013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 312/608] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:26 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:26.252177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:26.258002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a5818d51-87fe-4777-b34d-e083984ab268 req-83919bbd-9d94-401a-a743-b1eb09e377e2 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.258466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a5818d51-87fe-4777-b34d-e083984ab268 req-83919bbd-9d94-401a-a743-b1eb09e377e2 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.271187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-a5818d51-87fe-4777-b34d-e083984ab268 req-83919bbd-9d94-401a-a743-b1eb09e377e2 service nova] Creating event network-vif-deleted:1f6c4f11-48fc-4f90-b715-0854c41b8c15 for instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f on hv-cinder-84617 Jul 18 10:47:26.271319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.271962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.275140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-a5818d51-87fe-4777-b34d-e083984ab268 req-83919bbd-9d94-401a-a743-b1eb09e377e2 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031968 Jul 18 10:47:26.276913 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 297/609] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:47:26.279475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.279908 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.280751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.281191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.398424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.399269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.406724 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.407249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.408169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.408672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.410307 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:26.419017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7b44870b-124b-4eb7-91ef-18f0ed36516f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1717 microversion: 2.1 time: 0.151515 Jul 18 10:47:26.424192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 313/610] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:26 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:26.477301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:26.485994 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8ab832bf-0439-41af-a3e7-5195d660473e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1472 microversion: 2.1 time: 0.091771 Jul 18 10:47:26.486559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 298/611] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:26 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1472 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:26.524816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.525321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.532239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.532710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.533485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.533924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.615163 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] HTTP exception thrown: Cannot 'detach_volume' instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f while it is in vm_state rescued Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Request method failure captured: Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments/237170ae-2ea8-4dd7-bc44-2316ef5112d2 HTTP/1.1 Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tk9SiiE0L5kH31TkXu9czHK7m_0icXDrH3ei5XbjQT4yzoh83KjKtdbHUtGLj8M8pL8mpHaBYYf5aN-h9yQ-JBWbZLk_qhFC__atD8Zi5dyMScdrMnYITxi1tT_Ee_r88TDSdM8Ctqdr64zb60A56tdFGsoNGhviR289oUogDo5eaE Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:47:26.617676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b0e325a6638442b9a2a929a6525f7c2e"}]}] Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: b86d6011a3f04ad0bf5b8be696c789f2 Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:47:26.619190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Cannot 'detach_volume' instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f while it is in vm_state rescued Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'server_id': '0b0c8e06-5c96-4c55-a8b1-04538edd8e8f', 'id': '237170ae-2ea8-4dd7-bc44-2316ef5112d2'} Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:26.619999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f while it is in vm_state rescued Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f while it is in vm_state rescued Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:26.621478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Returning 409 to user: Cannot 'detach_volume' instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f while it is in vm_state rescued {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:26.622614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5b30a12f-2a8a-468e-8ae1-735321b6f597 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments/237170ae-2ea8-4dd7-bc44-2316ef5112d2" status: 409 len: 152 microversion: 2.1 time: 0.098420 Jul 18 10:47:26.622614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 314/612] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:47:26 2022] DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments/237170ae-2ea8-4dd7-bc44-2316ef5112d2 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 10:47:26.628497 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:26.629060 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.634982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.635428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.636710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.637145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.869108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-94278e65-2555-451b-a86b-5d2fb8358a40 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/action" status: 202 len: 0 microversion: 2.1 time: 0.244408 Jul 18 10:47:26.869831 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 299/613] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:47:26 2022] POST /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:26.878286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.878897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.884962 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.885406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.886761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.887193 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.982936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:26.983585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:26.989733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.990178 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:26.990927 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:26.991346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.019751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:27.027900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3eac0247-9770-4b23-8f92-fbf654ffc419 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.153348 Jul 18 10:47:27.028720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 315/614] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:26 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:27.132595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:27.140664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5c0382e9-6f8e-4c0d-b139-c3b78ca1b330 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1313 microversion: 2.1 time: 0.162057 Jul 18 10:47:27.141352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 300/615] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:26 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:27.267546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:27.268394 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:27.274791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:27.275649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.284201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:27.284201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.412767 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:27.420710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2d13f0c0-5fd8-4d93-bddb-56256c08fe89 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.156987 Jul 18 10:47:27.421270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 316/616] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:27 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:27.502963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:27.503500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:27.509489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:27.509926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.511347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:27.512005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.542767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:27.543213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:27.543669 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lazy-loading 'fault' on Instance uuid 8a16e60a-09cc-47f1-afee-0dad5805fa1f {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:27.585699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f862a8b7b4534d1ba7d65b4688c32b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bac9bcfdd4ef4a6d87f593bde0c352c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:27.593728 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-41d9eb02-d56f-4e79-81bd-a516decd761e tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 200 len: 1309 microversion: 2.1 time: 0.094586 Jul 18 10:47:27.594270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 301/617] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:27 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:28.046107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.046834 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.053006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.053465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.054560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.054814 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.072585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:28.157925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.158537 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.164838 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.165284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.166063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.166490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.198682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:28.227894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-23430c58-b413-4a7d-aefb-331e30e3ad99 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.186402 Jul 18 10:47:28.228885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 317/618] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:28 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:28.322017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:28.330131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d3ba115-4891-4f12-867c-2ad03cb93f0b tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1462 microversion: 2.1 time: 0.176076 Jul 18 10:47:28.330756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 302/619] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:28 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1462 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:28.370882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.371430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.378492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.378939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.379703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.380135 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.406202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:47:28.441502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.443400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.449884 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.450338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.451114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.451585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.587785 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:28.596131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7aac4235-1beb-4c65-a9e0-8bbb59125d0c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.161190 Jul 18 10:47:28.596713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 303/620] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:28 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:28.611813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.612422 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] [instance: 8a16e60a-09cc-47f1-afee-0dad5805fa1f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.619122 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.619572 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.620386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.620851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.634320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] HTTP exception thrown: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Request method failure captured: Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f HTTP/1.1 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlpkGAXJSis_EIEmN6OfWEuP3NLCyy_a43BVHNZkD5R2oLqT4ZIiUa9Izegb60IVd5RlrmWlQ5sp2h5dqwrUO7phc8CiycI2dD-5seRPl684O6F7GOjy-3wZ_W1zz1rNqpHjUQgrQRWyeZIg4sWuU3wZvGGkV5TmhH7VqURWQyeayI Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: bac9bcfdd4ef4a6d87f593bde0c352c9 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:47:28.635976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/bac9bcfdd4ef4a6d87f593bde0c352c9"}]}] Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: bac9bcfdd4ef4a6d87f593bde0c352c9 Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1915935287 Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesSnapshotTestJSON-1915935287-project Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: f862a8b7b4534d1ba7d65b4688c32b92 Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesSnapshotTestJSON-1915935287-project Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. Jul 18 10:47:28.637512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '8a16e60a-09cc-47f1-afee-0dad5805fa1f'} Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:28.638415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. Jul 18 10:47:28.639908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:28.641194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] Returning 404 to user: Instance 8a16e60a-09cc-47f1-afee-0dad5805fa1f could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:28.641194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bdb568a4-f669-4acb-bd84-8bd1737991f4 tempest-VolumesSnapshotTestJSON-1915935287 tempest-VolumesSnapshotTestJSON-1915935287-project] 10.222.0.47 "GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f" status: 404 len: 111 microversion: 2.1 time: 0.029978 Jul 18 10:47:28.641194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 304/621] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:28 2022] GET /compute/v2.1/servers/8a16e60a-09cc-47f1-afee-0dad5805fa1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:47:28.834440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e94fae27-6d43-432b-a890-50ae3b9bf53c tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "DELETE /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 204 len: 0 microversion: 2.1 time: 0.467280 Jul 18 10:47:28.834955 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 318/622] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:47:28 2022] DELETE /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:47:28.843047 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:28.843658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:28.849597 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.850043 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.850795 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:28.851228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:28.986509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:28.993797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-16de2a35-ba1c-43c4-b8f8-26f21afcb5c4 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.154561 Jul 18 10:47:28.994445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 305/623] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:28 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:29.246753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:29.247456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:29.253642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:29.254092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:29.254859 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:29.255294 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:29.400198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:29.406586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-92f12a12-4f36-47ee-aa88-96c81d73f16e tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.164705 Jul 18 10:47:29.407151 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 319/624] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:29 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:29.615696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:29.616261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:29.623803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:29.624389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:29.625177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:29.625605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:29.757921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:29.765626 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c93645ad-a52e-45aa-bc11-0bf096e3042d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.153960 Jul 18 10:47:29.766181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 306/625] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:29 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:30.011284 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:30.012050 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:30.018291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.018743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.019499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.019936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.149568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:30.157830 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1d940cda-7eab-4717-8d2b-9b5fe67e079a tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.150402 Jul 18 10:47:30.158395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 320/626] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:30 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:30.423592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:30.424262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:30.430651 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.431180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.431889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.433046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.562863 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:30.570807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f3adf6c7-c9c5-4ac8-bdfd-0d43f3292ccf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.151129 Jul 18 10:47:30.571369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 307/627] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:30 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:30.783040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:30.783651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:30.790708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.791159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.792803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:30.793223 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:30.928581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:30.936387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6865722-d942-4e53-86a0-945cf0ca36a9 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.157210 Jul 18 10:47:30.937042 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 321/628] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:30 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:31.175713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:31.176265 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:31.183605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.184041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.184817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.185243 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.316821 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:31.324423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-aaec69b0-97bc-4c08-89a3-45962b1877a3 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.152629 Jul 18 10:47:31.325022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 308/629] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:31 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:31.588926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:31.589594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:31.595603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.596051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.596833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.597269 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.727295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:31.735785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7135d58f-77e6-4d40-9958-a5a86b2e8757 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.151170 Jul 18 10:47:31.736334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 322/630] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:31 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:31.954074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:31.954938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:31.961018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.961467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.962224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:31.962661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:31.967385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:32.091639 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:32.099295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a202de0b-ca66-4893-8c6a-942b35c3778d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.148979 Jul 18 10:47:32.099831 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 309/631] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:31 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:32.341796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:32.342407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:32.348857 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.349357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.350059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.350753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.483356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:32.490633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-62c1d661-7d9f-4f3d-aca9-0213840b8fdf tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.152780 Jul 18 10:47:32.491185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 323/632] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:32 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:32.752846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:32.753360 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:32.760859 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.761309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.762056 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:32.762487 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:32.889674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:32.897659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c89dc690-4691-4d59-a848-e1a90132baf5 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.148994 Jul 18 10:47:32.898211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 310/633] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:32 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:33.116240 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.116870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.122975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.123421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.124170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.124606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.254256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:33.263328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8cd1ae6e-dc91-4325-bf67-baf81a84264c tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.150874 Jul 18 10:47:33.264511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 324/634] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:33 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:33.507507 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.508026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.514433 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.514872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.515616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.516039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.648400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:33.658145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d58415d-4ec6-4f29-9f4f-edc86a725d91 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.154253 Jul 18 10:47:33.659096 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 311/635] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:33 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:33.778494 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.779016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.785591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.786043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.786804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.787241 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.810640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-310cf852-07a6-4353-ae44-d2408876425f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/ips" status: 200 len: 148 microversion: 2.1 time: 0.036482 Jul 18 10:47:33.811196 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 325/636] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:47:33 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:33.822495 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c151d374-bf48-41f8-a9d5-7ac7a892cd62"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:33.823789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.830605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.831050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.831866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.832302 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.913578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/os-volume_attachments HTTP/1.1 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 74 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:47:33.915319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {"volumeAttachment": {"volumeId": "c151d374-bf48-41f8-a9d5-7ac7a892cd62"}} Jul 18 10:47:33.918295 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'server_id': 'a9a657a9-33a7-4766-8064-5084f549db71', 'body': {'volumeAttachment': {'volumeId': 'c151d374-bf48-41f8-a9d5-7ac7a892cd62'}}} Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:33.919064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:33.921411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:33.922665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:33.922665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:33.922665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:33.922665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 Jul 18 10:47:33.922665 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:33.922982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.923141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 400 to user: Invalid volume: volume c151d374-bf48-41f8-a9d5-7ac7a892cd62 is already attached to instances: 6158dc6a-973a-4cad-b71a-e607de559786 {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:33.923218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.923307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b5a54cad-7383-4008-89ea-53644c080542 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098292 Jul 18 10:47:33.923307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 312/637] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:47:33 2022] POST /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:47:33.924539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.925006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.925790 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.926215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.931408 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:33.931408 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:33.937526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.937978 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.938749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:33.939201 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:33.965413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:47:34.056973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.065554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-296409ad-e914-4246-83c6-889087d94a7d tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1725 microversion: 2.1 time: 0.154221 Jul 18 10:47:34.066113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 326/638] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:33 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:34.281287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:34.281964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:34.288886 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.289331 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.290078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.290512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.374316 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-eb458af4-5ef0-4f4c-9b7d-b27e4258b3f1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 204 len: 0 microversion: 2.1 time: 0.447405 Jul 18 10:47:34.375031 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 313/639] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:47:33 2022] DELETE /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:47:34.383348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:34.384144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:34.391533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.391726 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.392545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.393086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.435014 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.442978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ef4d3824-7dd2-44e6-8c4a-9f1e2bc65ad1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1676 microversion: 2.1 time: 0.165594 Jul 18 10:47:34.445396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 327/640] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:34 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:34.536182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.544846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-454ca50a-e568-4d90-87cd-ef76aa9db46f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1679 microversion: 2.1 time: 0.165514 Jul 18 10:47:34.545399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 314/641] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:34 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:34.675546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:34.676107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:34.682496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.683259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.684022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:34.684456 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:34.812633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:34.820053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a90a0fbc-521a-4fce-a576-75d983d38497 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.148466 Jul 18 10:47:34.820634 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 328/642] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:34 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:35.083162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.084044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.091672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.092115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.093018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.093448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.226375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:35.234644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4aa3085f-f289-48bd-9c51-6067e2613aaa tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1731 microversion: 2.1 time: 0.155552 Jul 18 10:47:35.235210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 315/643] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:35.251909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.252647 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.259425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.260058 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.261469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.262047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.340532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d88e99be-92a4-415d-b0e4-15c132ba14a6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092625 Jul 18 10:47:35.341171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 329/644] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:35.462484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.463100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.469226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.469679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.470446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.470892 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.561894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.562499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.568585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.569060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.569823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.570274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.777761 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:35.787589 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3723c558-8964-4f6d-b536-f7f175482bce tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1653 microversion: 2.1 time: 0.328098 Jul 18 10:47:35.787944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 316/645] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1653 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:35.804074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4e5b2286-1d80-4a1b-ab9f-749eb94ab032 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:35.810947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e5b2286-1d80-4a1b-ab9f-749eb94ab032 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.811391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4e5b2286-1d80-4a1b-ab9f-749eb94ab032 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.834136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4e5b2286-1d80-4a1b-ab9f-749eb94ab032 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Going to try to start instance {{(pid=124844) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 10:47:35.851297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:35.859592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5ad1e29f-13f4-4107-9cca-a4a957127163 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1679 microversion: 2.1 time: 0.301483 Jul 18 10:47:35.869287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 330/646] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1679 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:35.869287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:35.869287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:35.872621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.874362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:35.874362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:35.874362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:36.064956 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4e5b2286-1d80-4a1b-ab9f-749eb94ab032 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action" status: 202 len: 0 microversion: 2.1 time: 0.263828 Jul 18 10:47:36.065986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 317/647] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:47:35 2022] POST /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:36.078215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:36.079768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:36.086854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:36.087992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:36.089582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:36.090028 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:36.131565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:36.140171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fc2ccb2d-98d6-499b-8b08-3e6190d5f506 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1468 microversion: 2.1 time: 0.278928 Jul 18 10:47:36.143813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 331/648] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:35 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1468 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:36.294130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:36.303798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f369de74-506e-42ed-b3f6-4320d6051f3e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1662 microversion: 2.1 time: 0.233001 Jul 18 10:47:36.305074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 318/649] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:36 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1662 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:36.764272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-2639340c-1ed8-4903-83c3-fc24b76b3180 req-952caa61-97a1-4b48-b1b1-b25f9a693fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c777c9f-638b-4453-8910-368eaa5654c1", "name": "network-vif-deleted", "tag": "35f5a63a-eaea-402c-ad49-fe72ae0a81ef"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:36.774877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-2639340c-1ed8-4903-83c3-fc24b76b3180 req-952caa61-97a1-4b48-b1b1-b25f9a693fcc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:36.775500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-2639340c-1ed8-4903-83c3-fc24b76b3180 req-952caa61-97a1-4b48-b1b1-b25f9a693fcc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:36.795825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-2639340c-1ed8-4903-83c3-fc24b76b3180 req-952caa61-97a1-4b48-b1b1-b25f9a693fcc service nova] Creating event network-vif-deleted:35f5a63a-eaea-402c-ad49-fe72ae0a81ef for instance 7c777c9f-638b-4453-8910-368eaa5654c1 on hv-cinder-84617 Jul 18 10:47:36.803081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-2639340c-1ed8-4903-83c3-fc24b76b3180 req-952caa61-97a1-4b48-b1b1-b25f9a693fcc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043205 Jul 18 10:47:36.804455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 332/650] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:36.877977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:36.879002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:36.888127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:36.890946 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:36.892107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:36.892772 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.161201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:37.162045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:37.179175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.179646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.180387 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.181056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.218608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.219234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.220048 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lazy-loading 'fault' on Instance uuid 7c777c9f-638b-4453-8910-368eaa5654c1 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:37.221932 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:37.311040 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:37.316451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6cdcd375-981d-4bfc-b273-9db511602a39 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1679 microversion: 2.1 time: 0.443068 Jul 18 10:47:37.317617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 319/651] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:36 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1679 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:37.319509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:37.322234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:37.323530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:37.331197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a8bde454-bc88-486f-a650-a3351987e5c9 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1303 microversion: 2.1 time: 0.174012 Jul 18 10:47:37.331736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 333/652] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:37 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1303 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:37.343512 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.344397 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.345231 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.345899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.492155 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-007ede7d-4ce9-4d0f-b02c-7027c073dbf3 req-31b78e00-7fb8-47c0-b788-5db5ece95aad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:37.498018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-007ede7d-4ce9-4d0f-b02c-7027c073dbf3 req-31b78e00-7fb8-47c0-b788-5db5ece95aad service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:37.498583 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-007ede7d-4ce9-4d0f-b02c-7027c073dbf3 req-31b78e00-7fb8-47c0-b788-5db5ece95aad service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:37.512182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-007ede7d-4ce9-4d0f-b02c-7027c073dbf3 req-31b78e00-7fb8-47c0-b788-5db5ece95aad service nova] Creating event network-changed:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:47:37.516404 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-007ede7d-4ce9-4d0f-b02c-7027c073dbf3 req-31b78e00-7fb8-47c0-b788-5db5ece95aad service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032848 Jul 18 10:47:37.517312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 334/653] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:47:37.640275 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:37.648262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7221133d-0dcc-4cca-befb-57d1363291bb tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1662 microversion: 2.1 time: 0.329583 Jul 18 10:47:37.650390 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 320/654] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:37 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1662 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:38.341467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:38.343119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:38.359746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:38.361154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:38.378616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.380986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.381444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.382225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.382662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.388396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.390685 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.391849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.461016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.463990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.465504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lazy-loading 'fault' on Instance uuid 7c777c9f-638b-4453-8910-368eaa5654c1 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:38.533758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:38.542495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33d681dd-369a-4ae2-80f0-528c61c7170d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1612 microversion: 2.1 time: 0.211100 Jul 18 10:47:38.543085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 335/655] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:38 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1612 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:38.562640 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '686a36a7925f4a4c95d821c644628dfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97b79ca700b4425ca0c6aa8a346e7eeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:38.570440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3b1280d5-afd3-4939-bf75-87f8566822e7 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 200 len: 1303 microversion: 2.1 time: 0.220073 Jul 18 10:47:38.572354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 321/656] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:38 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 1303 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:38.669516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:38.670417 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:38.676621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.677501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.678283 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:38.678723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:38.894238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:38.904469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-26e0ad9f-71a5-4927-97e9-6534c5e82e1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1666 microversion: 2.1 time: 0.240643 Jul 18 10:47:38.907872 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 336/657] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:38 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1666 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:39.543242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}, {"server_uuid": "a9a657a9-33a7-4766-8064-5084f549db71", "name": "network-vif-deleted", "tag": "1611fb00-fc26-446c-8dfe-3b5162dc9845"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:39.560671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:39.561364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:39.570586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.575644 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.576845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.577445 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.581443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.582067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.606917 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] Creating event network-changed:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:47:39.607344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] Creating event network-vif-deleted:1611fb00-fc26-446c-8dfe-3b5162dc9845 for instance a9a657a9-33a7-4766-8064-5084f549db71 on hv-cinder-84617 Jul 18 10:47:39.615321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-db572ed6-9009-4dd9-b818-8d7807e26d87 req-1c9d5c32-aee5-4619-925e-9d6e87cdd37e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.076267 Jul 18 10:47:39.620874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 322/658] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:39.635596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.636233 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.636718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'fault' on Instance uuid a9a657a9-33a7-4766-8064-5084f549db71 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:39.640486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:39.641264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] [instance: 7c777c9f-638b-4453-8910-368eaa5654c1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:39.647930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.649871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.651920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:39.652566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:39.672242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] HTTP exception thrown: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Request method failure captured: Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 HTTP/1.1 Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1Toqzu41Rze2S5bYyMtWvWELTXgHy7UWdOXW3TiKW3wuW6J4pQCvwLEHH-LYrOd_vQP8eJ8uC9EWATbK4ETjRNo4czj1YJ5P89jA36hnhlitl-e8XZDUP4Dn5xmdvsN3mqtjClthMB7jehP6L43zjcnk9MHmSKR83eshXiQuRbjioag Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 97b79ca700b4425ca0c6aa8a346e7eeb Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesNegativeTest-759856111 Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:47:39.681312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/97b79ca700b4425ca0c6aa8a346e7eeb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_97b79ca700b4425ca0c6aa8a346e7eeb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/97b79ca700b4425ca0c6aa8a346e7eeb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/97b79ca700b4425ca0c6aa8a346e7eeb"}]}] Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesNegativeTest-759856111 Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 97b79ca700b4425ca0c6aa8a346e7eeb Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesNegativeTest-759856111 Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesNegativeTest-759856111-project Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 686a36a7925f4a4c95d821c644628dfb Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesNegativeTest-759856111-project Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. Jul 18 10:47:39.682972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '7c777c9f-638b-4453-8910-368eaa5654c1'} Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:39.683919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. Jul 18 10:47:39.685588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:39.688147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] Returning 404 to user: Instance 7c777c9f-638b-4453-8910-368eaa5654c1 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:39.688147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2b3abc48-979a-4df1-92fe-58cefae87a71 tempest-VolumesNegativeTest-759856111 tempest-VolumesNegativeTest-759856111-project] 10.222.0.47 "GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1" status: 404 len: 111 microversion: 2.1 time: 0.061229 Jul 18 10:47:39.688147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 323/659] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:39 2022] GET /compute/v2.1/servers/7c777c9f-638b-4453-8910-368eaa5654c1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:47:39.738382 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:39.746474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f9e295bc-7718-47c2-b467-48020d330b73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 200 len: 1331 microversion: 2.1 time: 0.190941 Jul 18 10:47:39.747061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 337/660] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:39 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 1331 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:40.763582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:40.764399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:40.771290 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:40.771733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:40.772489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:40.772942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:40.778226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:40.788225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 HTTP/1.1 Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:47:40.789942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:47:40.792038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'a9a657a9-33a7-4766-8064-5084f549db71'} Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:40.794289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:47:40.795528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:40.797273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:40.797273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-156c7f44-2aa9-4b5c-be34-01d181c988da tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 404 len: 111 microversion: 2.1 time: 0.031982 Jul 18 10:47:40.797273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 324/661] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:40 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:47:40.801247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-13ef5f6b-ef22-437b-b36c-cd9aa1c1eb14 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '.version_select at 0x7f5f0a69d8b0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:40.887022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-13ef5f6b-ef22-437b-b36c-cd9aa1c1eb14 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-642224676" status: 202 len: 0 microversion: 2.1 time: 0.089649 Jul 18 10:47:40.887609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 338/662] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Jul 18 10:47:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-642224676 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:41.734368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:41.734857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:41.741513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.741961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:41.742723 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:41.743162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:41.826867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'services' on Instance uuid 6158dc6a-973a-4cad-b71a-e607de559786 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:42.101888 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5b635712-bbf2-4226-bfa7-c069d258a339 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments/c151d374-bf48-41f8-a9d5-7ac7a892cd62" status: 202 len: 0 microversion: 2.1 time: 0.371253 Jul 18 10:47:42.102700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 325/663] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:47:41 2022] DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments/c151d374-bf48-41f8-a9d5-7ac7a892cd62 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:42.112363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:42.114579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:42.120698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:42.121512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:42.121901 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:42.122292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:42.153300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-82397632-4f5b-409d-b323-ceace85ed929 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045479 Jul 18 10:47:42.153856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 339/664] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:47:42 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:43.165573 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:43.167244 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:43.174133 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:43.178052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:43.178052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:43.178052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:43.205141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ef5efbdd-2c14-4149-8f72-27ad806198ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043848 Jul 18 10:47:43.205697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 326/665] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:47:43 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:44.216927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:44.217848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:44.225688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.226217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:44.227066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:44.227605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:44.262900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e5776d94-dc32-4735-8a6d-1e3141badddb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050137 Jul 18 10:47:44.263729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 340/666] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:47:44 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:45.274076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:45.274993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:45.282288 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.282733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.283491 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.283925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.313658 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2ee5186b-4a5e-4b06-8266-0c177f2812e4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043483 Jul 18 10:47:45.314203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 327/667] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:47:45 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:47:45.370841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:45.371491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:45.378104 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.378547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.379407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.379830 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.405770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:47:45.802398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-58c980c0-4d81-4311-ab92-285c8c48016e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 204 len: 0 microversion: 2.1 time: 0.435553 Jul 18 10:47:45.802987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 341/668] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:47:45 2022] DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:47:45.812140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:45.812778 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:45.819143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.827786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:45.827786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:45.827786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.200710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:46.208357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-969e9181-41ef-4c0c-999c-a5999a18f7d9 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1681 microversion: 2.1 time: 0.400052 Jul 18 10:47:46.208951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 328/669] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:45 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1681 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:46.249854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.255077 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.257004 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.257650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.258415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.258846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.292025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8d717eac-ab21-41c7-aab3-d8ef4252ff28 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments/f7fe5214-d602-44e1-a10a-9edfa5535005" status: 200 len: 194 microversion: 2.20 time: 0.045990 Jul 18 10:47:46.292631 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 342/670] 10.222.0.47 () {60 vars in 1453 bytes} [Mon Jul 18 10:47:46 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments/f7fe5214-d602-44e1-a10a-9edfa5535005 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:47:46.365355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.368596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.373266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.373721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.374485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.374912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.459251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lazy-loading 'services' on Instance uuid f60e0663-4f73-4a3c-b76a-5e1c40a2b432 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:46.726940 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-382171ac-b8d2-4dde-b5c6-4419b7bdbf75 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments/f7fe5214-d602-44e1-a10a-9edfa5535005" status: 202 len: 0 microversion: 2.20 time: 0.365739 Jul 18 10:47:46.727522 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 329/671] 10.222.0.47 () {60 vars in 1456 bytes} [Mon Jul 18 10:47:46 2022] DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments/f7fe5214-d602-44e1-a10a-9edfa5535005 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:47:46.736531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:46.737469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:46.743796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.744272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.745227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:46.745661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:46.783704 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f5dbec5d-d343-4f04-93cd-0b4871f00850 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050954 Jul 18 10:47:46.784284 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 343/672] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Jul 18 10:47:46 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:47:47.226672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:47.227399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:47.235174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.235618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.236406 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.236871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.375090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:47.382902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8ca83f61-4044-4406-a927-094c36ad3f81 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1681 microversion: 2.1 time: 0.160380 Jul 18 10:47:47.383481 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 330/673] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:47 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:47.796314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:47.797433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:47.803508 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.803952 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.804738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:47.805174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:47.834898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6935b762-0e44-4ed4-84f4-912899780742 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042591 Jul 18 10:47:47.835418 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 344/674] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Jul 18 10:47:47 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:47:48.399879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:48.401151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:48.407740 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.408300 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.409220 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.416002 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.543691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:48.551856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-61391813-1b26-49f2-a319-71c3036bcb3d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1681 microversion: 2.1 time: 0.155959 Jul 18 10:47:48.552422 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 331/675] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:48 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:48.850109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:48.852884 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:48.856742 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b4eaf72b-d70e-49dc-919d-65aad492e420 req-a6b3d002-b100-49fc-b36f-eb1c13c5f688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6158dc6a-973a-4cad-b71a-e607de559786", "name": "network-vif-deleted", "tag": "5cdc2dfe-53a8-4444-ba69-41d081778649"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:48.870418 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.870985 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.875580 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b4eaf72b-d70e-49dc-919d-65aad492e420 req-a6b3d002-b100-49fc-b36f-eb1c13c5f688 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.875744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.875859 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b4eaf72b-d70e-49dc-919d-65aad492e420 req-a6b3d002-b100-49fc-b36f-eb1c13c5f688 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.875955 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.886023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b4eaf72b-d70e-49dc-919d-65aad492e420 req-a6b3d002-b100-49fc-b36f-eb1c13c5f688 service nova] Creating event network-vif-deleted:5cdc2dfe-53a8-4444-ba69-41d081778649 for instance 6158dc6a-973a-4cad-b71a-e607de559786 on hv-cinder-84617 Jul 18 10:47:48.891831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b4eaf72b-d70e-49dc-919d-65aad492e420 req-a6b3d002-b100-49fc-b36f-eb1c13c5f688 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047263 Jul 18 10:47:48.895396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 345/676] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:48.910837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-797874cb-151c-4e38-b604-3f2b1ce9dbd3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.064894 Jul 18 10:47:48.917042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 332/677] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Jul 18 10:47:48 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:48.977420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:48.978087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:48.990725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.991191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:48.996188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:48.996188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.021188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:47:49.305723 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-79650672-aafe-4f4a-be6e-9b6d1912c17d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 204 len: 0 microversion: 2.20 time: 0.332047 Jul 18 10:47:49.307315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 346/678] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Jul 18 10:47:48 2022] DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:47:49.315498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:49.316528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:49.322385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:49.323206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.324037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:49.324561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.467177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.475325 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.476850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.478015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b0a09cec-8589-4046-af95-ee024ef293b9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.166375 Jul 18 10:47:49.479427 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 333/679] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:49 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:47:49.576753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:49.577462 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:49.584243 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:49.584706 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.585480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:49.585973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.614219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:49.617782 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:49.618226 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:49.618670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'fault' on Instance uuid 6158dc6a-973a-4cad-b71a-e607de559786 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:49.663035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:49.671617 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2dd1fa64-73d6-4a86-98a2-9cba4e974509 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1331 microversion: 2.1 time: 0.099353 Jul 18 10:47:49.672251 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 347/680] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:49 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:50.499221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:50.499721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:50.506245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.506695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.507455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.507889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.643774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:50.653817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:50.655356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:50.656551 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-55f7b809-7652-4ddf-9107-c26d05ce4e0a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.161248 Jul 18 10:47:50.657146 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 334/681] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:50 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:50.688921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:50.689531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:50.696340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.696825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.698194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.698622 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.713966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:50.729705 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:50.730145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:50.730590 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'fault' on Instance uuid 6158dc6a-973a-4cad-b71a-e607de559786 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:50.772320 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:50.780321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d3753630-ee80-49d4-9033-a01df2350317 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 200 len: 1331 microversion: 2.1 time: 0.095147 Jul 18 10:47:50.780948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 348/682] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:50 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 1331 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:51.675336 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:51.675944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:51.682900 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.683347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.684128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.684552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.799101 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:51.799726 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:51.807445 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.807892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.808650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:51.809100 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:51.823947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:51.834961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 HTTP/1.1 Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:47:51.836630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:47:51.838919 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '6158dc6a-973a-4cad-b71a-e607de559786'} Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:51.839861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:47:51.849248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:47:51.850376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:51.850376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:51.850376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0bec43cb-a374-4237-ac81-35fb3c0a3291 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1722 microversion: 2.20 time: 0.172029 Jul 18 10:47:51.850614 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 335/683] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:51 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:47:51.850687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:51.850687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f1fc27f9-1945-43fe-9108-d46b283d3c5a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 404 len: 111 microversion: 2.1 time: 0.052365 Jul 18 10:47:51.850687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 349/684] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:51 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:47:51.858110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-02c9e478-94ee-4d58-9835-12f8042c75f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '.version_select at 0x7f5f0a80d8b0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:52.014639 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-02c9e478-94ee-4d58-9835-12f8042c75f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-948545523" status: 202 len: 0 microversion: 2.1 time: 0.162193 Jul 18 10:47:52.015229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 336/685] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Jul 18 10:47:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-948545523 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:47:52.142194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-1de94c25-0b94-4249-a28d-b94d5fa31e10 req-16f490d7-b93c-40c1-b609-bbc8ea3ea5fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f60e0663-4f73-4a3c-b76a-5e1c40a2b432", "name": "network-vif-deleted", "tag": "b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:52.153677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1de94c25-0b94-4249-a28d-b94d5fa31e10 req-16f490d7-b93c-40c1-b609-bbc8ea3ea5fc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.154372 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-1de94c25-0b94-4249-a28d-b94d5fa31e10 req-16f490d7-b93c-40c1-b609-bbc8ea3ea5fc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.169322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-1de94c25-0b94-4249-a28d-b94d5fa31e10 req-16f490d7-b93c-40c1-b609-bbc8ea3ea5fc service nova] Creating event network-vif-deleted:b3b9a054-b0ad-409c-9a5e-b23ea93ebe8d for instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 on hv-cinder-84617 Jul 18 10:47:52.175034 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-1de94c25-0b94-4249-a28d-b94d5fa31e10 req-16f490d7-b93c-40c1-b609-bbc8ea3ea5fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036612 Jul 18 10:47:52.176291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 350/686] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:47:52.862859 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:52.864235 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:52.873006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.873402 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.874184 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.874699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.918850 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-aa7b1657-d4b0-4eda-8b27-691d0be56696 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: .version_select at 0x7f5f0a6d3e50>, body: {"keypair": {"name": "tempest-keypair-395567766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMY5ydJyVwlGZ2orIh4lVn3Toz/QXGf5mB5PZi2SLWJ+/+Ma7S2CPaqQywKI8hDCXzV97gEobZae4lNMAYVq6RRu8/v95/d9jRbTXNdtmavcVY3zOpR+WDWML8xR5xloFA=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:52.925294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:52.925845 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:52.926396 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lazy-loading 'fault' on Instance uuid f60e0663-4f73-4a3c-b76a-5e1c40a2b432 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:47:52.937931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-aa7b1657-d4b0-4eda-8b27-691d0be56696 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:52.946277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-aa7b1657-d4b0-4eda-8b27-691d0be56696 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:52.980966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.989046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.990803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:52.992013 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-031a96dc-7472-483b-a7f4-e8d9c2e902bb tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 200 len: 1371 microversion: 2.20 time: 0.133755 Jul 18 10:47:52.992859 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 337/687] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:52 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 1371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:53.060106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-aa7b1657-d4b0-4eda-8b27-691d0be56696 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.147861 Jul 18 10:47:53.060722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 351/688] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:47:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:47:54.014084 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:54.014711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:54.021234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.021674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.022450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:54.022872 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:54.037365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 HTTP/1.1 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:47:54.039010 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:47:54.040492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f60e0663-4f73-4a3c-b76a-5e1c40a2b432'} Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:47:54.041826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:47:54.042988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:47:54.044022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:47:54.044022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cfb1c97e-93f7-416b-81e3-467a2c41f2f5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 404 len: 111 microversion: 2.20 time: 0.030238 Jul 18 10:47:54.044022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 338/689] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:54 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:47:54.050551 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-03982a9a-7818-44f3-ad2b-fc30c2829d82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '.version_select at 0x7f5f0a61aee0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:54.157013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-03982a9a-7818-44f3-ad2b-fc30c2829d82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-987356706" status: 204 len: 0 microversion: 2.20 time: 0.110654 Jul 18 10:47:54.157591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 352/690] 10.222.0.47 () {60 vars in 1258 bytes} [Mon Jul 18 10:47:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-987356706 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:47:55.073855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1ade739b-7e05-48fb-bb37-b60f2536bc69 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: .version_select at 0x7f5f0a5b5f70>, body: {"keypair": {"name": "tempest-keypair-2135740351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOsZxpFyabXdE5Yt6/i9EBbZ/lRKR4Bhay2TvgLXQJQvNCfSHD+5Bq/v8ARj+ePJIfmZ0T/Yl8X+Nqury1eBd1qA1fhawKfFmPcv35OU6Dqq0rNO1gEjXWayRoXR7JkuA=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:55.083249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:47:55.089216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-1ade739b-7e05-48fb-bb37-b60f2536bc69 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:55.093454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-1ade739b-7e05-48fb-bb37-b60f2536bc69 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for user df7a3101955b481f9a582168731ae76c and project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:55.192180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1ade739b-7e05-48fb-bb37-b60f2536bc69 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.122380 Jul 18 10:47:55.193100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 339/691] 10.222.0.47 () {62 vars in 1199 bytes} [Mon Jul 18 10:47:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 124 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 10:47:55.936064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1668911566", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c67416e9-65e7-4c80-a421-5c4140e97b67"}], "security_groups": [{"name": "tempest-securitygroup--329272981"}], "key_name": "tempest-keypair-395567766", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:56.094342 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] validate_networks() for [('c67416e9-65e7-4c80-a421-5c4140e97b67', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:56.724715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:56.725150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:56.725624 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:56.726063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:56.726473 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:56.735395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.739956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.739956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:56.739956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:56.754463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:56.758394 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:56.769980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:56.772326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:56.941719 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8fcb4335-d4df-4982-b9eb-59916c86236b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.012580 Jul 18 10:47:56.943037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 353/692] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:47:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:47:56.953368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d26c6d87-29f9-41c3-aa16-8bc636093c7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:56.954938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d26c6d87-29f9-41c3-aa16-8bc636093c7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:57.215461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d26c6d87-29f9-41c3-aa16-8bc636093c7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:57.222386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d26c6d87-29f9-41c3-aa16-8bc636093c7f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1241 microversion: 2.1 time: 0.272963 Jul 18 10:47:57.222939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 340/693] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:56 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1241 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:57.794728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-339655032", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1e30748c-0952-4f2b-8af8-e6ac162a4aec"}], "security_groups": [{"name": "tempest-securitygroup--620710257"}], "key_name": "tempest-keypair-2135740351", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:47:58.112033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] validate_networks() for [('1e30748c-0952-4f2b-8af8-e6ac162a4aec', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:47:58.239714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:58.240362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:58.248297 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.249005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.249778 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.250212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.323662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.332170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d13969a6-77e1-44ba-84b3-4e443eaab30b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1245 microversion: 2.1 time: 0.096585 Jul 18 10:47:58.333006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 341/694] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:58 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:47:58.517541 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:47:58.517964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:47:58.518441 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:47:58.518846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:47:58.519253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:47:58.528411 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.528881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.529671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:58.530102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:58.546678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:47:58.550678 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Getting quotas for user df7a3101955b481f9a582168731ae76c and project ad323d7f7c484b5bb161d92791c9c7d7. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:47:58.565993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:47:58.568098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:47:58.733016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a4be974c-edac-4fef-ba79-27ebeed08ecd tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.943110 Jul 18 10:47:58.737839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 354/695] 10.222.0.47 () {62 vars in 1187 bytes} [Mon Jul 18 10:47:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 944 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 10:47:58.744535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:58.745162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:58.804812 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.816346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.818716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:58.820114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a9dafebb-8e0b-412b-b21e-1767177eab2e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1281 microversion: 2.20 time: 0.080232 Jul 18 10:47:58.820949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 342/696] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:58 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:47:59.351683 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:59.352294 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:59.359549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.360016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.360828 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:47:59.361266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:47:59.427095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:59.435804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-01ce0de8-51cc-4f99-b2c6-267da06e6237 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1293 microversion: 2.1 time: 0.089528 Jul 18 10:47:59.436625 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 355/697] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:47:59 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:47:59.839852 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:47:59.840790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:47:59.900947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:59.908552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:59.910069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:47:59.911141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d8a44376-48ee-4933-93ca-0904a5732ddc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1281 microversion: 2.20 time: 0.076347 Jul 18 10:47:59.911678 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 343/698] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:47:59 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:00.459807 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:00.460815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:00.468444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.469042 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.469878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.470565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.536068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:00.543602 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b04b56a8-14ad-4412-9845-5f9a9f41a7f2 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1299 microversion: 2.1 time: 0.087648 Jul 18 10:48:00.544170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 356/699] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:00 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:00.929825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:00.930475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:00.937840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.938287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:00.939052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:00.939505 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.006105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.017710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.021515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.021515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be762d2b-e577-48b8-8312-7022f20d6f5b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1333 microversion: 2.20 time: 0.094581 Jul 18 10:48:01.021515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 344/700] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:00 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:01.562536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:01.562914 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:01.569303 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.570095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.571017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:01.572539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:01.802873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:01.812725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f84a0d09-aa99-4690-bf02-a151769c05c4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.254396 Jul 18 10:48:01.815760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 357/701] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:01 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:02.038582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.039748 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.047560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.048225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.053479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.053479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.089532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:02.169439 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:02.178161 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:02.179980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:02.181629 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4276b945-fd61-4975-8b1d-62001c280cac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1339 microversion: 2.20 time: 0.146754 Jul 18 10:48:02.183864 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 345/702] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1339 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:02.238585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-fd6a3a44-5ded-4aff-9376-4add1d180bad req-3226ed70-5382-49c7-81ac-ef80519ff951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f", "tag": "764f064d-660b-4a4c-a48d-d8ee3575e925"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:02.268138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-fd6a3a44-5ded-4aff-9376-4add1d180bad req-3226ed70-5382-49c7-81ac-ef80519ff951 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.268899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-fd6a3a44-5ded-4aff-9376-4add1d180bad req-3226ed70-5382-49c7-81ac-ef80519ff951 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.283175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-fd6a3a44-5ded-4aff-9376-4add1d180bad req-3226ed70-5382-49c7-81ac-ef80519ff951 service nova] Creating event network-changed:764f064d-660b-4a4c-a48d-d8ee3575e925 for instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f on hv-cinder-84617 Jul 18 10:48:02.291296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-fd6a3a44-5ded-4aff-9376-4add1d180bad req-3226ed70-5382-49c7-81ac-ef80519ff951 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055611 Jul 18 10:48:02.291991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 358/703] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:02.834475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:02.835988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:02.845677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.846457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:02.848250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:02.848933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.106511 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.118304 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ffb0b072-3c91-4900-ab69-24f13cf12bb6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.289823 Jul 18 10:48:03.120338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 346/704] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:02 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:03.201758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:03.203278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:03.215493 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.217514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.220111 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.220984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.419073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.436808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.439126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:03.440523 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2eb7a5d0-d3ed-4e98-b018-64e74e782ce5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.244854 Jul 18 10:48:03.456390 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 359/705] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:03 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:03.825003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-45b7ea41-ffae-4a52-adbe-34b45e2902d5 req-554bb974-dc9e-404d-b585-bfebafc975d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:03.839795 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-45b7ea41-ffae-4a52-adbe-34b45e2902d5 req-554bb974-dc9e-404d-b585-bfebafc975d7 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:03.840257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-45b7ea41-ffae-4a52-adbe-34b45e2902d5 req-554bb974-dc9e-404d-b585-bfebafc975d7 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:03.856486 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-45b7ea41-ffae-4a52-adbe-34b45e2902d5 req-554bb974-dc9e-404d-b585-bfebafc975d7 service nova] Creating event network-changed:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:48:03.862954 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-45b7ea41-ffae-4a52-adbe-34b45e2902d5 req-554bb974-dc9e-404d-b585-bfebafc975d7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042555 Jul 18 10:48:03.864159 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 347/706] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:04.135393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.135998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.141945 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.142376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.143157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.143593 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.277171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.284632 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91842aff-658f-4b01-9b27-8bc16e32924c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.153217 Jul 18 10:48:04.285290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 360/707] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:04.463756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:04.464628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:04.474467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.475216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.478056 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:04.484265 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:04.647515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.657197 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.658699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:04.659813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6785897a-0aa0-421c-9e2b-6668e3d1bf1c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.203848 Jul 18 10:48:04.660362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 348/708] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:04 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:05.302147 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:05.303548 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:05.311698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.312258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.313225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.315127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.529191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.537424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-39adf777-70bd-43c5-9f0c-94d730c62659 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.239311 Jul 18 10:48:05.538260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 361/709] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:05 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:05.677923 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:05.679046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:05.692091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.692827 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.693796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:05.694398 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:05.845341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.854233 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.855730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:05.856897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ec40bd95-f4d3-46d8-91ce-0a176ad52d2b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.182773 Jul 18 10:48:05.857452 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 349/710] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:05 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:06.555409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:06.556402 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:06.564134 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.564577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.565651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.566222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.732197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:06.746826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4a94f248-9b89-4547-8391-14d547a23d1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.195686 Jul 18 10:48:06.750781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 362/711] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:06 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:06.875014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:06.875632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:06.882154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.882631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:06.883395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:06.883856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.027036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.036776 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.041050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.041050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3e0aee49-24c1-4542-a8fa-6b98b4b5a9ac tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.168577 Jul 18 10:48:07.041050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 350/712] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:06 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:07.764651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:07.771524 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:07.772150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.772600 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.773709 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:07.774312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:07.987649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:07.995792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5e6a1b76-e26e-479d-b536-feb0536ebb26 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.235239 Jul 18 10:48:07.996438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 363/713] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:07 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:08.058266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:08.058879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:08.065767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.066407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.067493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.068139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.233835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.241815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.243468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:08.244902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3e8539b9-a820-4083-803b-1f3b52bead41 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.190788 Jul 18 10:48:08.245933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 351/714] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:08 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:08.748977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-5b4ebd21-94df-495c-9461-a5d45cf1c8e6 req-d180eb9c-6f9e-4ec2-925a-d6e0a299e537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f", "name": "network-vif-plugged", "status": "completed", "tag": "764f064d-660b-4a4c-a48d-d8ee3575e925"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:08.753885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:08.754599 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=16 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:08.764013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5b4ebd21-94df-495c-9461-a5d45cf1c8e6 req-d180eb9c-6f9e-4ec2-925a-d6e0a299e537 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:08.764506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5b4ebd21-94df-495c-9461-a5d45cf1c8e6 req-d180eb9c-6f9e-4ec2-925a-d6e0a299e537 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:08.777300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-5b4ebd21-94df-495c-9461-a5d45cf1c8e6 req-d180eb9c-6f9e-4ec2-925a-d6e0a299e537 service nova] Creating event network-vif-plugged:764f064d-660b-4a4c-a48d-d8ee3575e925 for instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f on hv-cinder-84617 Jul 18 10:48:08.784054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-5b4ebd21-94df-495c-9461-a5d45cf1c8e6 req-d180eb9c-6f9e-4ec2-925a-d6e0a299e537 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039846 Jul 18 10:48:08.785396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 364/715] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:09.014611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:09.050425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.050425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.050425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.050425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.051014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.174903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.186805 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-521126fa-f28f-48d3-9ae6-dcb5f3c8b079 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.177616 Jul 18 10:48:09.187529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 352/716] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:09 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:09.269326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:09.270015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:09.276842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.277300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.278083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:09.278520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:09.483291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.491572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.493245 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:09.494681 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1f67a876-d2bc-4a5b-9f36-f065a4e00df0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.235029 Jul 18 10:48:09.495363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 365/717] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:09 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:48:09.906644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:10.179241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.179908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.186776 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.187648 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.188436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.188901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.206514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.209086 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.225594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.226364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.228892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.229554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.315653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'services' on Instance uuid 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:10.448831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.457210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-12eff2b2-930d-4bac-8e3b-735357968649 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1366 microversion: 2.1 time: 0.256001 Jul 18 10:48:10.472801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 366/718] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:10.517590 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.517590 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.522529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.523293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.526288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.526856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.826187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.836808 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.839865 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:10.841515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0a3f4600-fba4-4930-bc6e-66b536041f22 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.331692 Jul 18 10:48:10.842619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 367/719] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:10.912170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-134e8553-1dc7-4ed5-a913-3193a8b14a41 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments/237170ae-2ea8-4dd7-bc44-2316ef5112d2" status: 202 len: 0 microversion: 2.1 time: 1.009456 Jul 18 10:48:10.913095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 353/720] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:48:09 2022] DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments/237170ae-2ea8-4dd7-bc44-2316ef5112d2 => generated 0 bytes in 1013 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:48:10.922247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:10.923287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:10.931772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.932604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.937018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:10.937510 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:10.983276 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02616cd7-f7d5-4e6d-b6f8-910cc400cccb tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065649 Jul 18 10:48:10.984924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 368/721] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:48:10 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:11.023391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-1b73ffed-f5aa-45f8-b329-80526d9291b9 req-e7099a05-cf0d-4fdc-8ec4-63752cfacbf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "name": "network-vif-plugged", "status": "completed", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:11.033581 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1b73ffed-f5aa-45f8-b329-80526d9291b9 req-e7099a05-cf0d-4fdc-8ec4-63752cfacbf0 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.034327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-1b73ffed-f5aa-45f8-b329-80526d9291b9 req-e7099a05-cf0d-4fdc-8ec4-63752cfacbf0 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.071025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-1b73ffed-f5aa-45f8-b329-80526d9291b9 req-e7099a05-cf0d-4fdc-8ec4-63752cfacbf0 service nova] Creating event network-vif-plugged:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:48:11.112828 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-1b73ffed-f5aa-45f8-b329-80526d9291b9 req-e7099a05-cf0d-4fdc-8ec4-63752cfacbf0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092335 Jul 18 10:48:11.114543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 354/722] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:11.488286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.488286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.488286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.488286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.489203 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.489203 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.635470 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:11.648149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a1067374-f755-4de0-bc38-5ea50ef49a42 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1556 microversion: 2.1 time: 0.176429 Jul 18 10:48:11.648744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 369/723] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1556 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:11.667720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.668899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.689671 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.691190 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.692020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.695620 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.848256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a2c09004-1fb2-4adf-96d8-2e3462561eaf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.185638 Jul 18 10:48:11.855501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 355/724] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-interface => generated 285 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:11.860207 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.861032 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:11.889003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.889003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.890149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:11.890593 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:11.995142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:11.996151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:12.009545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.010479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.011268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:12.011708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:12.061618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cc81d251-cb37-44b7-9be7-5c28b73c8ce4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071369 Jul 18 10:48:12.065715 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 356/725] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:12.281420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.284257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=100 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:12.293669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.295434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:12.297967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5b5e1643-e925-4731-bab8-d74687fd6e68 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.441550 Jul 18 10:48:12.300541 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 370/726] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:11 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:13.075741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.076850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.083630 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.084332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.085206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.085708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.119407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ec64ff6a-8110-4709-8558-5486bf0b6790 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050040 Jul 18 10:48:13.120106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 357/727] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:48:13.203499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.204255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.211266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.212057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.213059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.213819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.244798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:48:13.317846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.318797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.327287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.327835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.328711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.329504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.597130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:13.673853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2afb478b-414d-49a2-a004-94be9acabb60 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 204 len: 0 microversion: 2.1 time: 0.474462 Jul 18 10:48:13.679027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 371/728] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:13 2022] DELETE /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:48:13.698833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.698995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.701286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.714252 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.714938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.716044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.716940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.721026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.722527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.724172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-decb8b95-09eb-4404-9d4c-ec1ae4a5ecfc tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1406 microversion: 2.20 time: 0.411867 Jul 18 10:48:13.725901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 358/729] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1406 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:13.901055 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:13.902487 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:13.913877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.917178 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.926212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:13.927153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:13.981535 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:13.981855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-51d35d98-317c-4d0b-b111-c7f6811fe699 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.079466 Jul 18 10:48:13.981855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 359/730] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:48:13.986609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3524253b-b4a1-4b84-ae2d-a9f8f20b83ba tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.300299 Jul 18 10:48:13.987620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 372/731] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:13 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:14.053001 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:14.053746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:14.060549 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.061410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.062470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.063051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.098191 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:48:14.285734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-e9967aa7-bf2a-4670-8a51-b2a27bfd1959 req-09ede62d-216e-4c57-9f19-a34b6cf51b4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f", "tag": "764f064d-660b-4a4c-a48d-d8ee3575e925"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:14.299444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e9967aa7-bf2a-4670-8a51-b2a27bfd1959 req-09ede62d-216e-4c57-9f19-a34b6cf51b4f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.299878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-e9967aa7-bf2a-4670-8a51-b2a27bfd1959 req-09ede62d-216e-4c57-9f19-a34b6cf51b4f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.331573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-e9967aa7-bf2a-4670-8a51-b2a27bfd1959 req-09ede62d-216e-4c57-9f19-a34b6cf51b4f service nova] Creating event network-changed:764f064d-660b-4a4c-a48d-d8ee3575e925 for instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f on hv-cinder-84617 Jul 18 10:48:14.341225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-e9967aa7-bf2a-4670-8a51-b2a27bfd1959 req-09ede62d-216e-4c57-9f19-a34b6cf51b4f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058889 Jul 18 10:48:14.342067 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 373/732] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:14.490273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ea4d7208-bc08-495b-b123-be6fcc06d9d5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 204 len: 0 microversion: 2.1 time: 0.440282 Jul 18 10:48:14.491655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 360/733] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:14 2022] DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:48:14.505127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:14.506138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:14.514858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.515546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.516510 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.517018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.730249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.742566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-911573ef-914a-49a6-aae6-99c5a56b095e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1672 microversion: 2.1 time: 0.244042 Jul 18 10:48:14.751015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 374/734] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:14.754444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:14.755168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:14.763040 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.763508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.764275 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:14.764738 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:14.784596 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:14.957454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.969968 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.972202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:14.974677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4aa7e1f2-0cd7-43bb-9a8d-5fe593cab730 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1598 microversion: 2.20 time: 0.234881 Jul 18 10:48:14.987457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 361/735] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1598 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:14.995735 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:15.000272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:15.003819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:15.004438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:15.005043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.005688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.006631 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.007296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.011255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.011774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.012786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.013389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.164405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-00edf1a1-c96f-482d-ba6b-2e614dccd6b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.174025 Jul 18 10:48:15.165146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 375/736] 10.222.0.47 () {60 vars in 1315 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:48:15.348107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.356466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-01e99803-5bf4-43db-aec3-5698d163c2d9 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.356554 Jul 18 10:48:15.363364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 362/737] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:14 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:15.762646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:15.763494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:15.771594 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.772332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.773367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:15.774094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:15.782856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4ec7ac9f-c77a-467f-83d8-8a651e3f7ee6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Action: 'create', calling method: .version_select at 0x7f5f0a6031f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-198427344", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQaZbZtthEva3Ho2xT6zpqqldRE1QKKwblv89cIXnLxvqqyyVvHscMmXK8BKZkvGciYJ604AwyH1pK//CQ6mhb9YWv0yuNbSLtIbjaAtltdVjmmyfpVTwVWlZ7knXzPKQ=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:15.803922 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4ec7ac9f-c77a-467f-83d8-8a651e3f7ee6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Getting quotas for project 6d89e2b7a84b4fb6ba7060088b60f6ae. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:48:15.808956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-4ec7ac9f-c77a-467f-83d8-8a651e3f7ee6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Getting quotas for user 3cd9bc14a25846189a81c3a6845fd551 and project 6d89e2b7a84b4fb6ba7060088b60f6ae. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:48:15.951706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:15.960424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-02accf5c-9542-4ecf-89d7-dfd8e7687980 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1672 microversion: 2.1 time: 0.203084 Jul 18 10:48:15.961024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 363/738] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:15 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:15.970364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4ec7ac9f-c77a-467f-83d8-8a651e3f7ee6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.299727 Jul 18 10:48:15.970364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 376/739] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:48:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:16.379690 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:16.380466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:16.388234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.389300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.390087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.390712 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.558212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:16.595604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8f9985a0-92de-40b7-ab02-6af035c6658c tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.219892 Jul 18 10:48:16.596534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 377/740] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:16 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:16.763137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-410fe0bc-6275-41a8-b42b-9e991ed0c8a7 req-f8baab97-e52e-4e8e-a58b-799c93b3c458 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:16.783937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-410fe0bc-6275-41a8-b42b-9e991ed0c8a7 req-f8baab97-e52e-4e8e-a58b-799c93b3c458 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.784617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-410fe0bc-6275-41a8-b42b-9e991ed0c8a7 req-f8baab97-e52e-4e8e-a58b-799c93b3c458 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:16.824588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-410fe0bc-6275-41a8-b42b-9e991ed0c8a7 req-f8baab97-e52e-4e8e-a58b-799c93b3c458 service nova] Creating event network-changed:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:48:16.833270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-410fe0bc-6275-41a8-b42b-9e991ed0c8a7 req-f8baab97-e52e-4e8e-a58b-799c93b3c458 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074144 Jul 18 10:48:16.834451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 364/741] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:16.979670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:16.981312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:16.996172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:16.998674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:17.002201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:17.002964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:17.273253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:17.284726 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e2be1e42-ed14-4dce-bc04-cb9a6054461e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1672 microversion: 2.1 time: 0.310091 Jul 18 10:48:17.285755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 378/742] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:16 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1672 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:17.617133 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:17.618610 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:17.625143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:17.625587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:17.626368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:17.626793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:17.796081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:17.813959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-31ceca44-1ab5-4e47-bc12-97c0cf1535f0 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.199301 Jul 18 10:48:17.818327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 365/743] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:17 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:18.303503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:18.304819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:18.316006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:18.316821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:18.317787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:18.318323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:18.470725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:18.480469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-229a8e2c-e5d1-4bc5-b378-dbda91101463 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1672 microversion: 2.1 time: 0.181687 Jul 18 10:48:18.481437 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 379/744] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:18 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:18.834335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:18.835021 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:18.841758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:18.842206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:18.842966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:18.843401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.064222 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:19.078400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5afa2b33-f2fa-4b31-b493-d07cdf4abf3b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.244163 Jul 18 10:48:19.085394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 366/745] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:18 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:19.499979 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:19.500575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:19.507192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:19.507638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.508439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:19.510988 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:19.671756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:19.679384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4393de06-073e-483e-a55d-1c391df31a1d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1672 microversion: 2.1 time: 0.184793 Jul 18 10:48:19.680036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 380/746] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:19 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1672 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:20.099606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:20.100372 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:20.112975 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.113573 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.114494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.115023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.269572 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:20.277922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7a646fa1-f092-4dac-a084-a90e777ec321 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1691 microversion: 2.1 time: 0.182479 Jul 18 10:48:20.278494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 367/747] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:20 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:20.697490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:20.698328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:20.706496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.706961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.707758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:20.708197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:20.783040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:20.792913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-055e50db-3ce3-4109-a938-a2d67e3e90c1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1605 microversion: 2.1 time: 0.099876 Jul 18 10:48:20.793497 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 381/748] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:20 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1605 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:21.219893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-b11db462-aabc-4dd0-8a29-e6f05cd3ae62 req-a2ae292e-63b7-41c1-9d36-7ee3ca616f7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b0c8e06-5c96-4c55-a8b1-04538edd8e8f", "name": "network-vif-deleted", "tag": "e08824a0-9688-486e-9ea5-8e75633c3dc3"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:21.230787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b11db462-aabc-4dd0-8a29-e6f05cd3ae62 req-a2ae292e-63b7-41c1-9d36-7ee3ca616f7e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.231446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b11db462-aabc-4dd0-8a29-e6f05cd3ae62 req-a2ae292e-63b7-41c1-9d36-7ee3ca616f7e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:21.248215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-b11db462-aabc-4dd0-8a29-e6f05cd3ae62 req-a2ae292e-63b7-41c1-9d36-7ee3ca616f7e service nova] Creating event network-vif-deleted:e08824a0-9688-486e-9ea5-8e75633c3dc3 for instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f on hv-cinder-84617 Jul 18 10:48:21.255632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-b11db462-aabc-4dd0-8a29-e6f05cd3ae62 req-a2ae292e-63b7-41c1-9d36-7ee3ca616f7e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039626 Jul 18 10:48:21.256489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 368/749] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:21.295789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:21.296407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:21.302847 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.303503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:21.304271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.304771 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:21.384055 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:21.391907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-53d4a35c-88a3-4d0f-9b52-1ea8c9581086 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1623 microversion: 2.1 time: 0.099840 Jul 18 10:48:21.392895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 382/750] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:21 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1623 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:21.930739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:21.931954 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:21.941088 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.941545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:21.942319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:21.942754 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.004576 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:22.005148 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.005605 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lazy-loading 'fault' on Instance uuid f01418be-d04a-4364-94f0-5c85f9244d63 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:22.055267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:22.064034 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a4196272-5faf-4130-bf40-c0dee98f1a49 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 200 len: 1326 microversion: 2.1 time: 0.255718 Jul 18 10:48:22.064867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 369/751] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:21 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 1326 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:22.411277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:22.411898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:22.425192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:22.425836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.426620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:22.427056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.467855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:22.469034 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:22.469717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'fault' on Instance uuid 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:22.518600 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:22.527132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ae1692cf-526a-441c-a4eb-8d796e8fc64b tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 200 len: 1335 microversion: 2.1 time: 0.120809 Jul 18 10:48:22.527710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 383/752] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:22 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:23.082720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:23.083366 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:23.090717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.091174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.091966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.092406 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.107147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 HTTP/1.1 Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:48:23.108970 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:48:23.110566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f01418be-d04a-4364-94f0-5c85f9244d63'} Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:23.111655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:48:23.113192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.114586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:23.114586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f956ef9b-b6d3-406f-bd12-4ae0da089abf tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 404 len: 111 microversion: 2.1 time: 0.031855 Jul 18 10:48:23.114586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 370/753] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:23 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:23.120109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-554056c2-e2de-4dea-98d3-ddfd3096e75b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '.version_select at 0x7f5f0a61a310>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:23.274635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-e26aa0af-0d54-443a-81d8-bc2d50cb563e req-d5cb241b-1398-4d88-9f20-10523e157779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f01418be-d04a-4364-94f0-5c85f9244d63", "name": "network-vif-deleted", "tag": "3e594084-0c85-472e-8fce-f850a026f396"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:23.280098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-554056c2-e2de-4dea-98d3-ddfd3096e75b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933571270" status: 202 len: 0 microversion: 2.1 time: 0.164054 Jul 18 10:48:23.280901 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 384/754] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Jul 18 10:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933571270 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:48:23.288741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-e26aa0af-0d54-443a-81d8-bc2d50cb563e req-d5cb241b-1398-4d88-9f20-10523e157779 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.288741 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-e26aa0af-0d54-443a-81d8-bc2d50cb563e req-d5cb241b-1398-4d88-9f20-10523e157779 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.296628 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-e26aa0af-0d54-443a-81d8-bc2d50cb563e req-d5cb241b-1398-4d88-9f20-10523e157779 service nova] Creating event network-vif-deleted:3e594084-0c85-472e-8fce-f850a026f396 for instance f01418be-d04a-4364-94f0-5c85f9244d63 on hv-cinder-84617 Jul 18 10:48:23.301682 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-e26aa0af-0d54-443a-81d8-bc2d50cb563e req-d5cb241b-1398-4d88-9f20-10523e157779 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031056 Jul 18 10:48:23.302211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 371/755] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:23.547749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:23.549230 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:23.556938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.557511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.558657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:23.559199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:23.581774 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] HTTP exception thrown: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Request method failure captured: Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f HTTP/1.1 Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tk9SiiE0L5kH31TkXu9czHK7m_0icXDrH3ei5XbjQT4yzoh83KjKtdbHUtGLj8M8pL8mpHaBYYf5aN-h9yQ-JBWbZLk_qhFC__atD8Zi5dyMScdrMnYITxi1tT_Ee_r88TDSdM8Ctqdr64zb60A56tdFGsoNGhviR289oUogDo5eaE Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:48:23.582941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b0e325a6638442b9a2a929a6525f7c2e"}]}] Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: b86d6011a3f04ad0bf5b8be696c789f2 Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. Jul 18 10:48:23.584492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '0b0c8e06-5c96-4c55-a8b1-04538edd8e8f'} Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:23.585481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. Jul 18 10:48:23.587567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:48:23.590455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Returning 404 to user: Instance 0b0c8e06-5c96-4c55-a8b1-04538edd8e8f could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:23.590455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4dd545c6-755e-43d6-8a43-c2bf0ef3273f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f" status: 404 len: 111 microversion: 2.1 time: 0.043784 Jul 18 10:48:23.590455 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 385/756] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:23 2022] GET /compute/v2.1/servers/0b0c8e06-5c96-4c55-a8b1-04538edd8e8f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:23.602186 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2026d3d7-cc0a-4357-8dbd-a48c9bfb1884 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '.version_select at 0x7f5f0a5a5f70>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:23.751419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2026d3d7-cc0a-4357-8dbd-a48c9bfb1884 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961816394" status: 202 len: 0 microversion: 2.1 time: 0.158463 Jul 18 10:48:23.752015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 372/757] 10.222.0.47 () {58 vars in 1220 bytes} [Mon Jul 18 10:48:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961816394 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:48:24.172768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0cbc5f8a-4f46-4ea6-a2dd-b482a100513a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: .version_select at 0x7f5f0a5e0430>, body: {"keypair": {"name": "tempest-keypair-1792368706", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOgeuhhI4izdMj6RY9GWXlxgxsuIgMkIPiEe//eXQoLhlAI80nSQLT+SS2g19tA5Kf5saBfe/be2f0F3kA1xI9Ta9jS4uaUHfKBtESnR9LKVrh8N3ejYzIsw3NoGZvQWQ=="}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:24.186748 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-0cbc5f8a-4f46-4ea6-a2dd-b482a100513a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for project 9e4aa903be8d4afc91f368051333848b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:48:24.190549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-0cbc5f8a-4f46-4ea6-a2dd-b482a100513a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for user 17e0c6def385441bbdde18c63b7d99e3 and project 9e4aa903be8d4afc91f368051333848b. Resources: {'key_pairs'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:48:24.288322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0cbc5f8a-4f46-4ea6-a2dd-b482a100513a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122132 Jul 18 10:48:24.288969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 386/758] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:48:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:27.188945 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:27.189560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:27.197168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.197625 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.198401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.198866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.213985 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-880398579", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d2dbda6c-55b0-4f7b-9d2c-cba5f0c84c63"}], "security_groups": [{"name": "tempest-securitygroup--1219200346"}], "key_name": "tempest-keypair-1792368706", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:27.236771 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:48:27.342258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] validate_networks() for [('d2dbda6c-55b0-4f7b-9d2c-cba5f0c84c63', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:48:27.701881 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7ee1ab02-ec1f-48e4-9154-110b5c4b5c1f tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 204 len: 0 microversion: 2.1 time: 0.516063 Jul 18 10:48:27.705489 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 373/759] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:27 2022] DELETE /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:48:27.714483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:27.715187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:27.717108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:27.722417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.722901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.724479 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.725009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.877101 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:48:27.877772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:48:27.878254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:48:27.882813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:48:27.882813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:48:27.890722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.891179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.891983 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:27.892444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:27.910011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for project 9e4aa903be8d4afc91f368051333848b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:48:27.913259 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:27.915866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Getting quotas for user 17e0c6def385441bbdde18c63b7d99e3 and project 9e4aa903be8d4afc91f368051333848b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:48:27.922068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-41f4ed62-c382-4cda-b1cc-2f1314103651 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1507 microversion: 2.1 time: 0.212760 Jul 18 10:48:27.922821 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 374/760] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:27 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1507 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:27.927674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:48:27.932730 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:48:28.103127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e3ec395c-7696-4843-82c9-245cb8d387a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.894751 Jul 18 10:48:28.103694 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 387/761] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:48:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:48:28.114471 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a1fe0546-ddf7-4b2e-8d1b-7737de70497b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:28.115260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a1fe0546-ddf7-4b2e-8d1b-7737de70497b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:28.175621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a1fe0546-ddf7-4b2e-8d1b-7737de70497b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:28.183561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a1fe0546-ddf7-4b2e-8d1b-7737de70497b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1237 microversion: 2.1 time: 0.073531 Jul 18 10:48:28.184185 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 375/762] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:28 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:28.940062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:28.940585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:28.947921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.948372 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:28.949621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:28.950069 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.081564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:29.089671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-96fbd2af-b418-467a-afce-dd82d5759c05 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1507 microversion: 2.1 time: 0.154140 Jul 18 10:48:29.090229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 388/763] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:28 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:29.200915 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:29.201465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:29.208221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.208670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.209450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:29.210647 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:29.272500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:29.280539 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c64bba96-ce95-44c6-838e-d8d094a19eda tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1241 microversion: 2.1 time: 0.083934 Jul 18 10:48:29.281158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 376/764] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:29 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:30.108150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:30.108725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:30.115167 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.115612 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.116366 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.116832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.255582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:30.263871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5607d26c-f478-4a0e-8908-dc00a78b2ab8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1507 microversion: 2.1 time: 0.159716 Jul 18 10:48:30.264442 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 389/765] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:30 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:30.297524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:30.298294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:30.317840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.317840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.317840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.317840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.370572 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:30.380234 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e56e1ef7-b328-4448-a9ff-4e5c79e41c8e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1233 microversion: 2.1 time: 0.086596 Jul 18 10:48:30.381153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 377/766] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:30 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1233 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:30.914885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-aa7876e0-f1c0-438a-bfd4-c8e7c7a2f0c6 req-16a3875f-e2df-42e0-9293-143a34c0631b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a77460bc-275e-4141-8386-f5ac57bddac1", "name": "network-vif-deleted", "tag": "535ac1fb-1cfa-4d73-b6f3-c11a89d00401"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:30.923464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-aa7876e0-f1c0-438a-bfd4-c8e7c7a2f0c6 req-16a3875f-e2df-42e0-9293-143a34c0631b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:30.923943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-aa7876e0-f1c0-438a-bfd4-c8e7c7a2f0c6 req-16a3875f-e2df-42e0-9293-143a34c0631b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:30.935983 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-aa7876e0-f1c0-438a-bfd4-c8e7c7a2f0c6 req-16a3875f-e2df-42e0-9293-143a34c0631b service nova] Creating event network-vif-deleted:535ac1fb-1cfa-4d73-b6f3-c11a89d00401 for instance a77460bc-275e-4141-8386-f5ac57bddac1 on hv-cinder-84617 Jul 18 10:48:30.941083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-aa7876e0-f1c0-438a-bfd4-c8e7c7a2f0c6 req-16a3875f-e2df-42e0-9293-143a34c0631b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029844 Jul 18 10:48:30.941673 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 390/767] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:31.281314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:31.282221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:31.288560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.289111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.290372 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.291138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.325076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.325760 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.325948 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'fault' on Instance uuid a77460bc-275e-4141-8386-f5ac57bddac1 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:31.380916 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:31.389187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c079fc58-c806-41d9-945a-d9dfe12081df tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 200 len: 1311 microversion: 2.1 time: 0.112339 Jul 18 10:48:31.390072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 378/768] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:31 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:31.399345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:31.400423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:31.406909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.407357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.408127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:31.408565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:31.423695 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:31.478090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:31.486924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-82f28798-32f6-430f-bb14-74949afc2376 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1297 microversion: 2.1 time: 0.092536 Jul 18 10:48:31.487500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 391/769] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:31 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1297 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:32.406937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.407853 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: a77460bc-275e-4141-8386-f5ac57bddac1] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.415561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.416098 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.417532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.417663 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.431908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] HTTP exception thrown: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Request method failure captured: Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 HTTP/1.1 Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1Tk9SiiE0L5kH31TkXu9czHK7m_0icXDrH3ei5XbjQT4yzoh83KjKtdbHUtGLj8M8pL8mpHaBYYf5aN-h9yQ-JBWbZLk_qhFC__atD8Zi5dyMScdrMnYITxi1tT_Ee_r88TDSdM8Ctqdr64zb60A56tdFGsoNGhviR289oUogDo5eaE Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:48:32.433696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b0e325a6638442b9a2a929a6525f7c2e"}]}] Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: b86d6011a3f04ad0bf5b8be696c789f2 Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. Jul 18 10:48:32.435267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'a77460bc-275e-4141-8386-f5ac57bddac1'} Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:32.436135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. Jul 18 10:48:32.437585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:32.438875 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Returning 404 to user: Instance a77460bc-275e-4141-8386-f5ac57bddac1 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:32.438875 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b721ecd4-75aa-453b-bddb-ec923857bfaf tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1" status: 404 len: 111 microversion: 2.1 time: 0.033487 Jul 18 10:48:32.441550 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 379/770] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:32 2022] GET /compute/v2.1/servers/a77460bc-275e-4141-8386-f5ac57bddac1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:32.447197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.447568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.454998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.455451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.456216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.456655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.484085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:48:32.503171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.503833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.520468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.524144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.524144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.524144 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.658510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:32.666662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f66c2af9-2a3b-4f9a-8dbd-0640b747b221 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.167170 Jul 18 10:48:32.667224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 380/771] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:32 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:32.853311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-af9feea8-c24b-4023-8112-13d77e3c3047 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "DELETE /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 204 len: 0 microversion: 2.1 time: 0.410304 Jul 18 10:48:32.854013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 392/772] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:48:32 2022] DELETE /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:48:32.861867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:32.862559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:32.868833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.869277 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.870038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:32.870473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:32.874380 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:33.032615 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:33.040984 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a59afe80-f2f4-4ee5-8ab8-7ff06f041a19 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.182820 Jul 18 10:48:33.041565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 381/773] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:32 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:33.186557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-fe1a3c9e-97e0-41e0-9c63-3e365f0e78a6 req-f131ac62-b662-419b-abd2-1ef59356e6ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbe51a1-543e-434e-8d6e-42c2b6a71a4e", "tag": "ef32bab6-9d9d-49a6-9432-3d3fc89864a3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:33.195115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-fe1a3c9e-97e0-41e0-9c63-3e365f0e78a6 req-f131ac62-b662-419b-abd2-1ef59356e6ce service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:33.195641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-fe1a3c9e-97e0-41e0-9c63-3e365f0e78a6 req-f131ac62-b662-419b-abd2-1ef59356e6ce service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:33.216300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-fe1a3c9e-97e0-41e0-9c63-3e365f0e78a6 req-f131ac62-b662-419b-abd2-1ef59356e6ce service nova] Creating event network-changed:ef32bab6-9d9d-49a6-9432-3d3fc89864a3 for instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e on hv-cinder-84617 Jul 18 10:48:33.221289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-fe1a3c9e-97e0-41e0-9c63-3e365f0e78a6 req-f131ac62-b662-419b-abd2-1ef59356e6ce service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040683 Jul 18 10:48:33.222124 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 393/774] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:33.686668 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:33.687280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:33.694848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:33.695007 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:33.696343 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:33.696802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:33.830339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:33.838196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e82dcdd7-70ca-4c20-8839-bbccd04c0fe2 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.155344 Jul 18 10:48:33.838799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 382/775] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:33 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:34.058511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:34.059216 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:34.065893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.066343 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.067098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.067531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.195869 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:34.203318 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-449f2c16-a541-44a9-a247-7ff408f12be4 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.149691 Jul 18 10:48:34.204126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 394/776] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:34 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:34.855695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:34.856303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:34.862815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.863266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.864025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:34.864456 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:34.994464 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:35.001867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1c496aca-cf7c-4200-83ad-e9de78e6094d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.150637 Jul 18 10:48:35.002423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 383/777] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:34 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:35.220243 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:35.220824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:35.227426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:35.227887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:35.228840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:35.229271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:35.358670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:35.394355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b8616688-39b3-4446-9ef2-47966f05e240 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.177990 Jul 18 10:48:35.394939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 395/778] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:35 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:36.019199 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:36.019805 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:36.026926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.027373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:36.028128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.028565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:36.158179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:36.166415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-67392d2e-a4ba-4798-b81d-86b58e15a064 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.151031 Jul 18 10:48:36.167289 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 384/779] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:36 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:36.413035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:36.413703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:36.422043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.422501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:36.423270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:36.423950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:36.564229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:36.571948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7b957cd4-b9bf-4360-8a9c-3b50b8ce83c8 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1522 microversion: 2.1 time: 0.162825 Jul 18 10:48:36.572516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 396/780] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:36 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:36.767646 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-698737836", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-198427344", "security_groups": [{"name": "tempest-secgroup-smoke-1927024886"}], "networks": [{"uuid": "8803cae4-2021-4747-8d1e-78b9fc4c78af"}], "block_device_mapping_v2": [{"uuid": "f057c493-5327-4092-9395-2720090e69ee", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:36.880352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] validate_networks() for [('8803cae4-2021-4747-8d1e-78b9fc4c78af', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:48:37.183775 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:37.184661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:37.190937 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.191388 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.192438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.193031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.369890 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:48:37.370357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:48:37.370758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:48:37.371214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:48:37.371623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:48:37.380918 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.381355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.382143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.382611 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.393535 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:37.400324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Getting quotas for project 6d89e2b7a84b4fb6ba7060088b60f6ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:48:37.400976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1848aefe-1729-455e-acd6-2a2ef833a20b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.221828 Jul 18 10:48:37.401547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 397/781] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:37 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:37.404369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Getting quotas for user 3cd9bc14a25846189a81c3a6845fd551 and project 6d89e2b7a84b4fb6ba7060088b60f6ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:48:37.468168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:48:37.469216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f057c493-5327-4092-9395-2720090e69ee',volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:48:37.587661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-0868c9e2-e7f7-4f38-b40a-26e353a3a148 req-c741fa91-b872-4cf5-9fd5-c277d2a500aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "177dc191-0770-4ba1-9219-e38d05c4091d", "name": "network-vif-deleted", "tag": "fc4600b0-7d19-4e9b-9742-053a0a1747fd"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:37.591389 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:37.597605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0868c9e2-e7f7-4f38-b40a-26e353a3a148 req-c741fa91-b872-4cf5-9fd5-c277d2a500aa service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.598053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-0868c9e2-e7f7-4f38-b40a-26e353a3a148 req-c741fa91-b872-4cf5-9fd5-c277d2a500aa service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.609736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-0868c9e2-e7f7-4f38-b40a-26e353a3a148 req-c741fa91-b872-4cf5-9fd5-c277d2a500aa service nova] Creating event network-vif-deleted:fc4600b0-7d19-4e9b-9742-053a0a1747fd for instance 177dc191-0770-4ba1-9219-e38d05c4091d on hv-cinder-84617 Jul 18 10:48:37.614819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-0868c9e2-e7f7-4f38-b40a-26e353a3a148 req-c741fa91-b872-4cf5-9fd5-c277d2a500aa service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087137 Jul 18 10:48:37.615489 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 398/782] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:48:37.620796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:37.621496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:37.627574 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.628020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.628813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:37.631999 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:37.698544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:37.706190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-53438a0f-0720-42d0-9669-897b7442ade6 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1480 microversion: 2.1 time: 0.089461 Jul 18 10:48:37.706930 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 399/783] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:37 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1480 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:38.071570 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-da0acdea-7e99-4c29-b588-3e4759c639a4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.307398 Jul 18 10:48:38.072159 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 385/784] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:48:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:48:38.083140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-588830db-40e0-4b9a-85b1-6690d0e49303 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:38.083846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-588830db-40e0-4b9a-85b1-6690d0e49303 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:38.086521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:38.087936 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=14 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:38.142687 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-588830db-40e0-4b9a-85b1-6690d0e49303 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:38.149400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-588830db-40e0-4b9a-85b1-6690d0e49303 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1087 microversion: 2.1 time: 0.070646 Jul 18 10:48:38.149964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 400/785] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:38 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1087 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:38.418233 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:38.418841 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:38.425057 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.425508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.426272 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.426711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.556849 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:38.564466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f0d9f320-9e92-4226-b533-09960a72f43e tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.150145 Jul 18 10:48:38.565055 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 386/786] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:38 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:38.724555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:38.725189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:38.732934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.733380 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.734127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.734561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.766279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:38.766708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:38.767221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lazy-loading 'fault' on Instance uuid 177dc191-0770-4ba1-9219-e38d05c4091d {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:38.811816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86d6011a3f04ad0bf5b8be696c789f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e325a6638442b9a2a929a6525f7c2e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:38.819200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-032555c4-7b91-4258-863e-5cac8e09b75a tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 200 len: 1311 microversion: 2.1 time: 0.099131 Jul 18 10:48:38.819751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 401/787] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:38 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:39.167166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3a8e2221-ba56-4a68-953c-4d38bee3b3eb tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:39.167775 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3a8e2221-ba56-4a68-953c-4d38bee3b3eb tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:39.221215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a8e2221-ba56-4a68-953c-4d38bee3b3eb tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:39.228534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3a8e2221-ba56-4a68-953c-4d38bee3b3eb tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1087 microversion: 2.1 time: 0.066135 Jul 18 10:48:39.229122 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 387/788] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:39 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1087 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:39.581780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:39.582393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:39.589311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.589760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.590516 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.590954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.723576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:39.732203 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f07ab6fd-da24-4816-95f1-8641931bc3a7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.154876 Jul 18 10:48:39.732875 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 402/789] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:39 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:39.837159 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:39.837695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] [instance: 177dc191-0770-4ba1-9219-e38d05c4091d] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:39.844215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.844696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.845445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:39.845942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:39.861587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] HTTP exception thrown: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Request method failure captured: Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d HTTP/1.1 Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1Tk9SiiE0L5kH31TkXu9czHK7m_0icXDrH3ei5XbjQT4yzoh83KjKtdbHUtGLj8M8pL8mpHaBYYf5aN-h9yQ-JBWbZLk_qhFC__atD8Zi5dyMScdrMnYITxi1tT_Ee_r88TDSdM8Ctqdr64zb60A56tdFGsoNGhviR289oUogDo5eaE Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:48:39.863086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/b0e325a6638442b9a2a929a6525f7c2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/b0e325a6638442b9a2a929a6525f7c2e"}]}] Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: b0e325a6638442b9a2a929a6525f7c2e Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1351475286 Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: b86d6011a3f04ad0bf5b8be696c789f2 Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1351475286-project Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. Jul 18 10:48:39.864592 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '177dc191-0770-4ba1-9219-e38d05c4091d'} Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:48:39.865527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. Jul 18 10:48:39.866897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:48:39.868293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] Returning 404 to user: Instance 177dc191-0770-4ba1-9219-e38d05c4091d could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:48:39.868293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d0a2591-11d4-4253-9262-aeb11d911b93 tempest-ServerRescueNegativeTestJSON-1351475286 tempest-ServerRescueNegativeTestJSON-1351475286-project] 10.222.0.47 "GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d" status: 404 len: 111 microversion: 2.1 time: 0.031965 Jul 18 10:48:39.868293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 388/790] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:39 2022] GET /compute/v2.1/servers/177dc191-0770-4ba1-9219-e38d05c4091d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:48:40.245398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:40.246737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:40.252966 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.253453 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:40.254266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.254724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:40.332556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:40.345033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5f0f5f44-89fd-46e7-8dc7-fdc1e8449737 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1129 microversion: 2.1 time: 0.102849 Jul 18 10:48:40.345626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 403/791] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:40 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1129 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:40.749169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:40.749783 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:40.756260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.765003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:40.765003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:40.765003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:40.902791 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:40.910867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d0486ceb-f794-413c-9d14-cf73106761ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.165509 Jul 18 10:48:40.911681 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 389/792] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:40 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:41.363833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:41.363833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:41.370659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:41.371112 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:41.372060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:41.372492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:41.438978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:41.449663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-356bdc7d-9748-4fa4-bde3-26288c69dd96 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1203 microversion: 2.1 time: 0.088733 Jul 18 10:48:41.449663 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 404/793] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:41 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1203 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:41.927529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:41.928145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:41.935425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:41.935954 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:41.936845 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:41.937349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.074930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:42.083759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be31b963-5e60-4263-8d63-52dc3f943e6d tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.160122 Jul 18 10:48:42.084326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 390/794] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:41 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:42.473739 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:42.475279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:42.484024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:42.484852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.485934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:42.486716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.681119 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:42.693560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a6be7529-3165-4014-b03a-f17841fc322b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1271 microversion: 2.1 time: 0.228749 Jul 18 10:48:42.703770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 405/795] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:42 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1271 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:42.861042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-8a5bc219-81a9-4456-9ae3-736505c7d606 req-86997206-81ce-4fba-8c57-42da0f6a0317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbe51a1-543e-434e-8d6e-42c2b6a71a4e", "name": "network-vif-plugged", "status": "completed", "tag": "ef32bab6-9d9d-49a6-9432-3d3fc89864a3"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:42.880109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-8a5bc219-81a9-4456-9ae3-736505c7d606 req-86997206-81ce-4fba-8c57-42da0f6a0317 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:42.880109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-8a5bc219-81a9-4456-9ae3-736505c7d606 req-86997206-81ce-4fba-8c57-42da0f6a0317 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:42.883477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-8a5bc219-81a9-4456-9ae3-736505c7d606 req-86997206-81ce-4fba-8c57-42da0f6a0317 service nova] Creating event network-vif-plugged:ef32bab6-9d9d-49a6-9432-3d3fc89864a3 for instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e on hv-cinder-84617 Jul 18 10:48:42.888935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-8a5bc219-81a9-4456-9ae3-736505c7d606 req-86997206-81ce-4fba-8c57-42da0f6a0317 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Jul 18 10:48:42.889767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 391/796] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:43.102481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:43.103175 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:43.110016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.110468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.111233 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.114692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.251708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:43.260543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e3449571-9bf5-4b0c-8899-73ceb7f22130 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.162895 Jul 18 10:48:43.261159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 406/797] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:43 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:43.712168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:43.712914 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:43.725889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.733463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.733463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:43.733463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:43.883181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:43.891695 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d9469200-62cd-4fd3-8c99-73610c492870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.184240 Jul 18 10:48:43.892373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 392/798] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:43 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:44.031006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-f98565bb-ca07-46aa-87b3-4d2eeb7b439f req-27a7d614-db7f-4062-901a-29c19dfca053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:44.041934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f98565bb-ca07-46aa-87b3-4d2eeb7b439f req-27a7d614-db7f-4062-901a-29c19dfca053 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.042378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-f98565bb-ca07-46aa-87b3-4d2eeb7b439f req-27a7d614-db7f-4062-901a-29c19dfca053 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.056209 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-f98565bb-ca07-46aa-87b3-4d2eeb7b439f req-27a7d614-db7f-4062-901a-29c19dfca053 service nova] Creating event network-changed:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:48:44.061298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-f98565bb-ca07-46aa-87b3-4d2eeb7b439f req-27a7d614-db7f-4062-901a-29c19dfca053 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033989 Jul 18 10:48:44.062130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 407/799] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:44.280565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:44.287673 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:44.290327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.290777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.291558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.292160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.428614 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:44.437857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e150e90-46a3-486d-9bfc-0f6346c9a51b tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1363 microversion: 2.1 time: 0.163837 Jul 18 10:48:44.438506 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 393/800] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:44 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:44.910567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:44.911270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:44.917640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.918140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:44.918899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:44.919328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.161842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:45.170563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3078836a-b2fa-4e45-bf00-52f5526cafa1 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.264330 Jul 18 10:48:45.180259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 408/801] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:44 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:45.456058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:45.456818 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:45.464988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.465739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.466742 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.467562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.601941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:45.609576 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fd990543-bfb8-45c6-b67e-742f9ae4254a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1550 microversion: 2.1 time: 0.158069 Jul 18 10:48:45.611087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 394/802] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:45 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:45.626389 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:45.626877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:45.633133 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.633577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.634425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:45.634862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:45.638540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:45.715591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e58762f2-fa97-4a02-81cc-99f3b514acbe tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092906 Jul 18 10:48:45.716176 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 409/803] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:48:45 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:46.187590 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:46.188200 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:46.194266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:46.195271 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:46.196378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:46.197575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:46.432563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:46.440513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-05b25d13-255b-4d08-b566-e2ee14a5d49e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.256890 Jul 18 10:48:46.441474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 395/804] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:46 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:46.943555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b97dd9bf-b27f-459d-a074-905df75e394f req-14c4d251-88d3-4ebe-8c59-294b12a33cd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecbe51a1-543e-434e-8d6e-42c2b6a71a4e", "tag": "ef32bab6-9d9d-49a6-9432-3d3fc89864a3"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:46.951626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b97dd9bf-b27f-459d-a074-905df75e394f req-14c4d251-88d3-4ebe-8c59-294b12a33cd3 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:46.952069 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b97dd9bf-b27f-459d-a074-905df75e394f req-14c4d251-88d3-4ebe-8c59-294b12a33cd3 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:46.963842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b97dd9bf-b27f-459d-a074-905df75e394f req-14c4d251-88d3-4ebe-8c59-294b12a33cd3 service nova] Creating event network-changed:ef32bab6-9d9d-49a6-9432-3d3fc89864a3 for instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e on hv-cinder-84617 Jul 18 10:48:46.968661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b97dd9bf-b27f-459d-a074-905df75e394f req-14c4d251-88d3-4ebe-8c59-294b12a33cd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164155 Jul 18 10:48:46.969289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 410/805] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:47.459131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:47.461232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:47.464254 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:47.469959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:47.470652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:47.471413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:47.472035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:47.641617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:47.649903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d5ed488d-4ef3-4fef-b290-a4f3b86c2d32 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.194953 Jul 18 10:48:47.650463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 396/806] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:47 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:48.668211 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:48.668948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:48.675379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.675827 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.676584 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:48.677070 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:48.732144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:48.816042 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:48.823725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-711403ed-4fa3-4979-9d3d-4341e4a2bd20 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.161296 Jul 18 10:48:48.824362 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 411/807] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:48 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:49.841239 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:49.841803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:49.844115 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:49.849094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:49.849543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:49.850333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:49.851283 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:49.994397 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:50.001857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-873d6d07-3a19-4b6d-b3c1-f01b8d2b7eb9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.164954 Jul 18 10:48:50.002431 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 397/808] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:49 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:51.019504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:51.020118 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:51.028550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:51.029027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:51.029795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:51.030234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:51.161404 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:51.170117 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b624a026-5636-4fc2-8d0e-87fbfbfd87ad tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.154343 Jul 18 10:48:51.170675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 412/809] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:51 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:52.187664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:52.188271 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:52.195039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.195519 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.196305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:52.196819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:52.330724 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:52.338789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b525c996-8dc2-41bb-b6b3-911f35b10049 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.155326 Jul 18 10:48:52.339347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 398/810] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:52 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:53.356704 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:53.357338 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:53.363795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.364212 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.365001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.365433 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.502849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:53.511476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-68ffd4a3-75a1-4b21-87d8-581207ad2c6b tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.158591 Jul 18 10:48:53.512037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 413/811] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:53 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:53.640059 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:53.640543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:53.646541 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.646990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.648407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:53.648879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:53.672171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5295c108-8617-432f-aaaf-f5d27ba0b687 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/ips" status: 200 len: 151 microversion: 2.20 time: 0.205512 Jul 18 10:48:53.672823 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 399/812] 10.222.0.47 () {60 vars in 1288 bytes} [Mon Jul 18 10:48:53 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/ips => generated 151 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 10:48:54.527654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:54.528269 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:54.540335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.540335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:54.540335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:54.540335 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:54.939703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:54.947944 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3919b24c-ee5e-4069-b21c-51f454f5dc0f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.424106 Jul 18 10:48:54.948514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 414/813] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:54 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:55.965376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:55.965990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:55.972511 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:55.972993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:55.973752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:55.974187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:56.104100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:56.111503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f42083cf-aa3d-4256-9d1b-a9e9602684b2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.149930 Jul 18 10:48:56.112065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 400/814] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:55 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:57.040286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:57.040824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:57.046970 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.047425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.048208 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.048640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.071916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-020b79bd-4d55-458e-9ee6-728f71f8863e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/ips" status: 200 len: 149 microversion: 2.1 time: 0.135081 Jul 18 10:48:57.072458 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 415/815] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:48:56 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/ips => generated 149 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:57.127423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:57.128058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:57.135195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.135873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.136641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:57.137100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:57.141036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:57.277613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:57.284972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-627299d4-6579-43fa-be6d-7d85cf5c9930 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.161503 Jul 18 10:48:57.285542 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 401/816] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:57 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:58.301787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:58.302400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:58.309513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.309957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.310711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.311141 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.443184 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:58.450677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-20b5973c-b5f2-4a55-947c-d991978e131e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.152793 Jul 18 10:48:58.451246 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 416/817] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:58 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:48:58.623772 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:58.624437 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:58.631589 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.632258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.633051 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.633485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.660447 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lazy-loading 'flavor' on Instance uuid 42cb3356-fc42-4e45-b81f-59e4d69fd664 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:48:58.783116 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:58.784225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:58.792228 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.792228 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:58.793256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:58.793873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.388939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c1b85a12-ef93-4528-8c8b-60e5a642041e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/action" status: 202 len: 0 microversion: 2.20 time: 0.770113 Jul 18 10:48:59.389635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 402/818] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Jul 18 10:48:58 2022] POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/action => generated 0 bytes in 772 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:48:59.398461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:59.399326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:59.402378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:48:59.406274 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.406726 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.414363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.414363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.542411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.550205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.551677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.552840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-118c3a6a-1874-42c8-ab43-d416fc7636b4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.159006 Jul 18 10:48:59.553382 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 403/819] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:48:59 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:48:59.557949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:48:59.558540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:48:59.564340 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.564910 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.565734 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.566228 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.705208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:48:59.713815 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-14b564fc-7091-486e-878a-6ff6b445f679 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.159069 Jul 18 10:48:59.714417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 404/820] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:48:59 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:48:59.775099 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-0a324ee5-800c-45cf-8751-7a80e792f3e9 req-6094fc7c-3e6b-43a1-810b-bbf00cd7fc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "name": "network-vif-plugged", "status": "completed", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:48:59.783194 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0a324ee5-800c-45cf-8751-7a80e792f3e9 req-6094fc7c-3e6b-43a1-810b-bbf00cd7fc1d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:48:59.783690 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-0a324ee5-800c-45cf-8751-7a80e792f3e9 req-6094fc7c-3e6b-43a1-810b-bbf00cd7fc1d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:48:59.794805 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-0a324ee5-800c-45cf-8751-7a80e792f3e9 req-6094fc7c-3e6b-43a1-810b-bbf00cd7fc1d service nova] Creating event network-vif-plugged:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:48:59.799700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-0a324ee5-800c-45cf-8751-7a80e792f3e9 req-6094fc7c-3e6b-43a1-810b-bbf00cd7fc1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084202 Jul 18 10:48:59.800285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 405/821] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:48:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:48:59.818819 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d435f395-d518-462a-a014-3fae52b6b03d tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.039592 Jul 18 10:48:59.820035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 417/822] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:48:58 2022] POST /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments => generated 194 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:00.576473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:00.577204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:00.583942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.584428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:00.585993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.586490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:00.716779 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:00.724705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:00.726904 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:00.728072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-acc4d66d-67ce-4d70-8b31-a067e50dced3 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.156931 Jul 18 10:49:00.728627 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 406/823] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:00 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:00.732161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:00.732978 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:00.739149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.739589 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:00.740344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:00.740809 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:00.875060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:00.882587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b0e0c9c5-e99c-4666-92b5-322d334b23d6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1259 microversion: 2.1 time: 0.154925 Jul 18 10:49:00.883150 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 418/824] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:00 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:01.750323 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:01.750958 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:01.758103 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.758576 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.759328 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.759752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.893123 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:01.900245 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:01.900895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:01.902504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:01.904053 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:01.905237 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7ae6763b-a99a-457d-a292-a0db8bc36a82 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.162593 Jul 18 10:49:01.905806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 407/825] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:01 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:01.907889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.908345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:01.909222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:01.909742 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.041171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:02.048794 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a9f9add6-75ea-4d21-9795-377aeb38a4f0 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1444 microversion: 2.1 time: 0.153394 Jul 18 10:49:02.049359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 419/826] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:01 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1444 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:02.064499 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:02.065127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:02.071619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.072070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.072860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.073305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.208039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:02.215614 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fcf5ccad-7118-4ee6-bc82-0d777280c1e4 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1444 microversion: 2.1 time: 0.154890 Jul 18 10:49:02.216173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 408/827] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:02 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:02.924016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:02.924625 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:02.931024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.931470 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:02.932218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:02.932649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:03.170884 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:03.179163 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:03.180729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:03.181907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dbff06cd-ba8e-4579-9b42-49145533ef87 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.261772 Jul 18 10:49:03.182635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 420/828] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:02 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:04.199662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:04.200267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:04.206758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:04.207394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:04.209632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:04.209632 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:04.422050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:04.433704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:04.435219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:04.436381 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b497b337-f543-4f5b-81b6-ae3e1cc97d21 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.240714 Jul 18 10:49:04.437108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 409/829] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:04 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:04.585842 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b77a8ce6-7b79-4674-bd9f-6db3ebe03179 req-078a0421-d230-4c95-8452-17570b159485 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:04.594676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b77a8ce6-7b79-4674-bd9f-6db3ebe03179 req-078a0421-d230-4c95-8452-17570b159485 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:04.595214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b77a8ce6-7b79-4674-bd9f-6db3ebe03179 req-078a0421-d230-4c95-8452-17570b159485 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:04.607732 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b77a8ce6-7b79-4674-bd9f-6db3ebe03179 req-078a0421-d230-4c95-8452-17570b159485 service nova] Creating event network-changed:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:49:04.612839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b77a8ce6-7b79-4674-bd9f-6db3ebe03179 req-078a0421-d230-4c95-8452-17570b159485 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031067 Jul 18 10:49:04.613715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 421/830] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:05.455396 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:05.456179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:05.463588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:05.464408 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:05.465367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:05.465889 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:05.611894 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:05.621697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:05.623337 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:05.624602 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4a66b6f6-115c-4cfa-b637-3e0004c04469 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.173691 Jul 18 10:49:05.625457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 410/831] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:05 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:06.644575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:06.645377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:06.652869 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.653339 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.654088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:06.654529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:06.792738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:06.800987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:06.802475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:06.803854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec7b800a-94ea-4f14-9aa2-d81c5c34704a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.163720 Jul 18 10:49:06.804575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 422/832] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:06 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:07.390152 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:07.391243 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.397683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.398134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.398897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.399324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.480808 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: POST /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments HTTP/1.1 Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 74 Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:49:07.482591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {"volumeAttachment": {"volumeId": "016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a"}} Jul 18 10:49:07.484358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'server_id': '25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f', 'body': {'volumeAttachment': {'volumeId': '016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a'}}} Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:49:07.485249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:07.487470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 400 to user: Invalid volume: volume 016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a is already attached to instances: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f6648e81-d6e8-42cf-a2f5-7128255215c8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097954 Jul 18 10:49:07.489656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 411/833] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:07 2022] POST /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:49:07.546038 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:07.546529 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.553701 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.554498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.555341 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.555853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.639772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'services' on Instance uuid 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:49:07.822177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:07.822776 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.829080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.829565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.830311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.830738 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.905788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fcdf67ff-d45a-4954-9462-debd5733a682 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments/016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a" status: 202 len: 0 microversion: 2.1 time: 0.363504 Jul 18 10:49:07.906476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 423/834] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:49:07 2022] DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments/016cb3a7-e56e-4a49-9ffc-4fe0c79a9d7a => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:49:07.915745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:07.917041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:07.924237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.924816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.925592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:07.926056 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:07.956430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3bd4ddd1-74be-41f7-805f-57b2752cde12 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045436 Jul 18 10:49:07.957028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 424/835] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:49:07 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:07.965713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:07.973679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:07.975659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:07.976943 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3d1a8be4-9c35-40f6-b6b1-9ab82a6d9261 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.158679 Jul 18 10:49:07.977488 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 412/836] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:07 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:08.967633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:08.968665 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:08.975190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.975649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:08.976415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:08.976894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:08.998202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:08.998202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:09.002429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:09.002929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.003375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.004136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.004566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.007504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b6b80e96-5ceb-4f45-b65f-9bb78a100067 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042837 Jul 18 10:49:09.008169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 425/837] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:49:08 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:49:09.066721 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:09.067481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:09.074743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.075182 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.075948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.076413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.102205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:49:09.140668 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:09.151226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:09.152754 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:09.153917 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3a780c82-7f9a-441d-8932-1977d222b2e0 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.162024 Jul 18 10:49:09.154490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 413/838] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:08 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:09.546004 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ce69fdd1-966e-4490-a4e8-3efdceb735fc tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 204 len: 0 microversion: 2.1 time: 0.483026 Jul 18 10:49:09.546503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 426/839] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:49:09 2022] DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:49:09.555608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:09.556224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:09.562251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.562704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.563457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:09.563935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:09.697781 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:09.705650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1c9c1e75-0dfd-43bf-bd5f-13f732feb291 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1680 microversion: 2.1 time: 0.154775 Jul 18 10:49:09.706216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 414/840] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:09 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:10.172652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:10.173379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:10.175708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:10.181060 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.181505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.182259 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.182691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.313627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.321671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.323140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.324273 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8cc65124-bc17-46ff-a934-2afedb09a571 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.155889 Jul 18 10:49:10.324843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 427/841] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:10 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:10.723167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:10.723959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:10.731416 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.731866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.732778 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:10.733216 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:10.869085 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:10.876468 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-42220e6f-c3cf-42b3-bbae-5268e886a9d8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1680 microversion: 2.1 time: 0.157128 Jul 18 10:49:10.877066 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 415/842] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:10 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:11.344161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:11.344815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:11.352079 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.352531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.353315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.353752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.491002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:11.498977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:11.500502 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:11.501932 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-844507da-d1d2-40d6-904c-c0558a6a3540 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.162017 Jul 18 10:49:11.502490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 428/843] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:11 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:11.895180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:11.896587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:11.904266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.904746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.905516 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:11.905953 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:11.924939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:12.042284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:12.049652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4729fd61-d472-427e-a8b3-7402857c8818 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1680 microversion: 2.1 time: 0.159430 Jul 18 10:49:12.051745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 416/844] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:11 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:12.418839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-64f6cf46-7d7c-40d0-b01b-6e5815fb6ee7 req-5156d146-a000-4cc6-92fa-c5bcf9042682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f", "name": "network-vif-deleted", "tag": "764f064d-660b-4a4c-a48d-d8ee3575e925"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:12.427503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-64f6cf46-7d7c-40d0-b01b-6e5815fb6ee7 req-5156d146-a000-4cc6-92fa-c5bcf9042682 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:12.428881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-64f6cf46-7d7c-40d0-b01b-6e5815fb6ee7 req-5156d146-a000-4cc6-92fa-c5bcf9042682 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:12.439918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-64f6cf46-7d7c-40d0-b01b-6e5815fb6ee7 req-5156d146-a000-4cc6-92fa-c5bcf9042682 service nova] Creating event network-vif-deleted:764f064d-660b-4a4c-a48d-d8ee3575e925 for instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f on hv-cinder-84617 Jul 18 10:49:12.444957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-64f6cf46-7d7c-40d0-b01b-6e5815fb6ee7 req-5156d146-a000-4cc6-92fa-c5bcf9042682 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029948 Jul 18 10:49:12.445545 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 429/845] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:12.520923 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:12.521568 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:12.529012 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:12.529461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:12.530236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:12.531166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:12.688485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:12.697634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:12.699212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:12.700374 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d75ac1fa-81cf-4a88-ae62-e996014fd812 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.183495 Jul 18 10:49:12.700965 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 417/846] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:12 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:13.067872 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:13.069199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:13.075627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.076061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.076929 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.077499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.110885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.111328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.111864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'fault' on Instance uuid 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:49:13.170423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:13.184478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3e360be3-3d11-475c-812d-4a1cec932fcb tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 200 len: 1331 microversion: 2.1 time: 0.120807 Jul 18 10:49:13.194558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 430/847] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:13 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:13.719187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:13.720037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:13.727458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.727947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.728731 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:13.729362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:13.872325 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:13.881108 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:13.883788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:13.885045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ce2a291c-eb32-447f-9c9d-5355679abb38 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.169953 Jul 18 10:49:13.891427 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 418/848] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:13 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:14.203240 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:14.204152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:14.211132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.211603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.212373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.212833 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.226536 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f HTTP/1.1 Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:49:14.228183 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:49:14.229840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f'} Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:49:14.230734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:49:14.232236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:49:14.233813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:49:14.233813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f0d4d9d2-70ba-460d-b3be-552133748d8f tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 404 len: 111 microversion: 2.1 time: 0.030349 Jul 18 10:49:14.233813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 431/849] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:14 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:49:14.238321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6e5415c3-3a0b-4b28-85da-4dd89e6acf67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '.version_select at 0x7f5f0a544310>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:14.332564 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6e5415c3-3a0b-4b28-85da-4dd89e6acf67 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-395567766" status: 202 len: 0 microversion: 2.1 time: 0.097805 Jul 18 10:49:14.333133 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 419/850] 10.222.0.47 () {58 vars in 1217 bytes} [Mon Jul 18 10:49:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-395567766 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:49:14.904945 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:14.905727 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:14.912043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.912555 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:14.913488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:14.913917 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:15.115279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:15.124145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:15.126457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:15.127846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-748fcb23-de52-4617-887e-ad735b02643e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.226758 Jul 18 10:49:15.147756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 432/851] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:14 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:15.158384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be2307cb-3493-471d-8d37-62dd1e468e56 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: .version_select at 0x7f5f0a585d30>, body: {"keypair": {"name": "tempest-keypair-1207779590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ1G7A0tlJNl78nJpd9/ikeFJc3Llafd+mdxRfDIUJfHdd+R7HCbYl/3+Ysedu/NIPXTXntJ9vRlkFH/jrM+Ob5sfVgegz0nnyg/vk0/OUCKqqtRuWhb1MhVXBrHNaUX+g=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:15.173992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-be2307cb-3493-471d-8d37-62dd1e468e56 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:15.178627 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-be2307cb-3493-471d-8d37-62dd1e468e56 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:15.279092 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be2307cb-3493-471d-8d37-62dd1e468e56 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.125029 Jul 18 10:49:15.280083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 420/852] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:49:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:16.149346 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:16.149957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:16.156563 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.157126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.157888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:16.158332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:16.311515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:16.320319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:16.321845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:16.323236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b26feda3-8ac9-4625-b6d4-431ed2524e2d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.178507 Jul 18 10:49:16.324009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 433/853] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:16 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:17.345732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:17.346534 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:17.353961 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.354424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.355312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:17.355743 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:17.646276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.655425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.657052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:17.658205 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a7152f17-7d39-4f53-83ae-bb7680dd7672 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1743 microversion: 2.20 time: 0.318564 Jul 18 10:49:17.661866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 421/854] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:17 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1743 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:18.502537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2041058707", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c67416e9-65e7-4c80-a421-5c4140e97b67"}], "security_groups": [{"name": "tempest-securitygroup--1416286865"}], "key_name": "tempest-keypair-1207779590", "user_data": "}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:18.605033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] validate_networks() for [('c67416e9-65e7-4c80-a421-5c4140e97b67', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:49:18.678888 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:18.679527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:18.687839 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.694363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.694363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:18.694363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:18.905054 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:18.914177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:18.915678 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:18.916855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1929ff14-02ad-404c-9f8c-2a08e3d589aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1743 microversion: 2.20 time: 0.242983 Jul 18 10:49:18.917465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 422/855] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:18 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1743 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:19.062120 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:49:19.062545 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:49:19.063094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:49:19.063578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:49:19.063986 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:49:19.073981 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.074719 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.075509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.075946 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.094840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:49:19.098948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Getting quotas for user 46d0d621460b4e5b877ef421d3503340 and project f76bdb50a5c540e9aeb2099b993d334b. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:49:19.110185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:49:19.112608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:49:19.238925 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-42aad9a2-a231-4e30-b8e6-8d73e5c22c6e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.740883 Jul 18 10:49:19.239440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 434/856] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:49:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:49:19.249732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b8dad1ca-1309-40bf-9f29-56cc4655cc1c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:19.250346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b8dad1ca-1309-40bf-9f29-56cc4655cc1c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.322206 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b8dad1ca-1309-40bf-9f29-56cc4655cc1c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:19.329497 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b8dad1ca-1309-40bf-9f29-56cc4655cc1c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1242 microversion: 2.1 time: 0.083743 Jul 18 10:49:19.332809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 423/857] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:19 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:19.936268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:19.938179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:19.946909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.947613 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:19.948490 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:19.949075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.097568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.107202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.109000 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.110168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b7e49e98-b6ac-4487-a323-097068beef83 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.178340 Jul 18 10:49:20.111210 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 435/858] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:19 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:20.352410 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:20.353664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:20.360644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.361208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.362242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:20.362830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:20.438213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:20.449252 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d91a22c3-97ce-436c-90e8-b24c3c660401 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1246 microversion: 2.1 time: 0.102592 Jul 18 10:49:20.449836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 424/859] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:20 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:21.131557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:21.131557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:21.142588 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.143110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.143892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.144323 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.386515 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.399894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.403604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.404922 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2ef44659-19e9-4f8c-8eb7-b140c75896aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.279583 Jul 18 10:49:21.405480 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 436/860] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:21 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:21.468258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:21.469637 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:21.479875 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.481038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.482018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.482926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.533014 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-ecc95779-1add-42d3-8e74-f011115ac101 req-f1a6385b-2ff1-49a6-923e-42706f2f7e5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "name": "network-vif-plugged", "status": "completed", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:21.554292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-ecc95779-1add-42d3-8e74-f011115ac101 req-f1a6385b-2ff1-49a6-923e-42706f2f7e5b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:21.555434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-ecc95779-1add-42d3-8e74-f011115ac101 req-f1a6385b-2ff1-49a6-923e-42706f2f7e5b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:21.568431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-ecc95779-1add-42d3-8e74-f011115ac101 req-f1a6385b-2ff1-49a6-923e-42706f2f7e5b service nova] Creating event network-vif-plugged:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:49:21.574081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-ecc95779-1add-42d3-8e74-f011115ac101 req-f1a6385b-2ff1-49a6-923e-42706f2f7e5b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047301 Jul 18 10:49:21.574851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 437/861] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:21.595035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:21.605219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be53e4fe-b5a7-4285-ac55-f6137f228413 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1294 microversion: 2.1 time: 0.141001 Jul 18 10:49:21.633428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 425/862] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:21 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1294 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:22.429736 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.430357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.438649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.440279 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.441554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.442305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.611937 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.621028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.622638 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.623958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-27457664-d5a2-4b18-8341-bf9627a6420b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.198991 Jul 18 10:49:22.635226 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 438/863] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:22.635473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:22.635473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:22.635473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.636104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.636343 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:22.636793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:22.827260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:22.837270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-28213f9a-c0cd-47f9-ae24-1e0cdbaa9169 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.214744 Jul 18 10:49:22.837905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 426/864] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:22 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:23.643253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:23.643873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:23.650793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.651245 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.652214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.652846 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.850693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:23.855803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:23.856413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:23.860395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:23.862010 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:23.863170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7e707b0a-b97d-4c44-92bd-ab70f82a813d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.224334 Jul 18 10:49:23.863286 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.863624 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.864389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:23.864845 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:23.876291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 439/865] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:23 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:24.053585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:24.063167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-aed4a6aa-2d28-44d9-b20e-2858a918d6b4 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.210490 Jul 18 10:49:24.072656 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 427/866] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:23 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:24.436826 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-347b337e-0549-42fd-8957-3031eca0611f req-2af4ffc6-0474-43b8-989c-7c9e5ffc0d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a86c322-9d0a-4c46-824b-b8cfb0366af4", "tag": "90a831be-ee4a-48e5-8fa1-6065a15c36e6"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:24.447355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-347b337e-0549-42fd-8957-3031eca0611f req-2af4ffc6-0474-43b8-989c-7c9e5ffc0d14 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.447800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-347b337e-0549-42fd-8957-3031eca0611f req-2af4ffc6-0474-43b8-989c-7c9e5ffc0d14 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.471095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-347b337e-0549-42fd-8957-3031eca0611f req-2af4ffc6-0474-43b8-989c-7c9e5ffc0d14 service nova] Creating event network-changed:90a831be-ee4a-48e5-8fa1-6065a15c36e6 for instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 on hv-cinder-84617 Jul 18 10:49:24.483982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-347b337e-0549-42fd-8957-3031eca0611f req-2af4ffc6-0474-43b8-989c-7c9e5ffc0d14 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060034 Jul 18 10:49:24.484760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 440/867] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:24.882633 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:24.883254 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:24.890106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.890799 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:24.891733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:24.892188 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.080303 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:25.081147 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:25.095607 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.096152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.097050 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:25.097560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:25.168419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:25.189132 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:25.190939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:25.192147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-01d802cb-69cb-41cf-aff1-bb95e7cdadf4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.313612 Jul 18 10:49:25.192730 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 428/868] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:24 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:25.361603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:25.373802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8b4a1794-e66a-4c09-bc4b-f2506c625582 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.296575 Jul 18 10:49:25.378053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 441/869] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:25 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:26.214908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:26.214908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:26.225565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.226313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.227362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.227988 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.403508 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:26.405317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:26.413478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.419997 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.421361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.422837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.423021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:26.423718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:26.424335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.425660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-58b11b9e-5f89-4083-b4c5-17bda45783ba tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.218261 Jul 18 10:49:26.436868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 429/870] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:26 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:26.632511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:26.632511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5a588e1b-455f-44b4-bf67-49e808be2bd1 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.235458 Jul 18 10:49:26.632511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 442/871] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:26 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:27.444661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:27.445386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:27.452530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.453120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.454153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.454589 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.611195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.621077 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.623415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.624798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2442e641-1277-4270-b315-8eaab82cd619 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.184680 Jul 18 10:49:27.625669 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 430/872] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:27 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:27.647578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:27.648868 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:27.655753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.656220 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.658533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:27.658981 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:27.818550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:27.821308 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:27.827581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d685d4f2-ff74-48e4-a935-4dd6be00995e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.184044 Jul 18 10:49:27.828570 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 443/873] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:27 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:28.643893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:28.644562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:28.652266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.652993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.653935 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.654376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.807129 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:28.816947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:28.818833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:28.820263 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-af337cbf-fa7a-48a5-b903-1117d1e79b1b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.180459 Jul 18 10:49:28.821056 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 431/874] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:28 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:28.845514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:28.847075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:28.855459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.856130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.857393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:28.858003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:28.997889 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:29.006192 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0363deb2-2e72-4cf3-bc53-5b38071ec3ab tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.164038 Jul 18 10:49:29.006905 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 444/875] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:28 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:29.839450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:29.840844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:29.847142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:29.848825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:29.849555 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:29.850594 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:29.851238 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.026452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:30.029827 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:30.030002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:30.036440 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:30.040465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:30.047805 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:30.049598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.051454 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:30.052218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.053078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.053513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.057604 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a0686b8d-4fab-43c0-a0e2-8204964c0f90 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.222113 Jul 18 10:49:30.061301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 432/876] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:29 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:30.219621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:30.227642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-77de7d37-63ed-4d2e-8ffb-de6f4c081852 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.208796 Jul 18 10:49:30.228205 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 445/877] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:30 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:30.619641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:30.620052 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:30.626768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.627428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.628242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:30.628696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:30.653493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1327f79b-bab9-4e0c-8816-855ce2ee10da tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/ips" status: 200 len: 147 microversion: 2.1 time: 0.038528 Jul 18 10:49:30.659457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 433/878] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:49:30 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/ips => generated 147 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:31.076125 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:31.077592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:31.086405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.086858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.087646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.088238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.229904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.237935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.239419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.241602 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dde031a2-ec7b-4213-932e-eeb06687c47c tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1738 microversion: 2.20 time: 0.170047 Jul 18 10:49:31.242166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 446/879] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:31 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1738 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:31.246083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:31.246721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:31.249087 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:31.254077 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.254524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.255311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.255941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.398306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:31.405947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-80176771-88fe-4d69-95db-c5c32202401c tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.163756 Jul 18 10:49:31.406545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 434/880] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:31 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:31.611691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-5a4bdfaf-10a0-46a9-a7bd-55c54cd6ba34 req-6468fe46-7df3-4813-b3c3-543800a3b2ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a86c322-9d0a-4c46-824b-b8cfb0366af4", "name": "network-vif-plugged", "status": "completed", "tag": "90a831be-ee4a-48e5-8fa1-6065a15c36e6"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:31.621486 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5a4bdfaf-10a0-46a9-a7bd-55c54cd6ba34 req-6468fe46-7df3-4813-b3c3-543800a3b2ee service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:31.622218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-5a4bdfaf-10a0-46a9-a7bd-55c54cd6ba34 req-6468fe46-7df3-4813-b3c3-543800a3b2ee service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:31.635285 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-5a4bdfaf-10a0-46a9-a7bd-55c54cd6ba34 req-6468fe46-7df3-4813-b3c3-543800a3b2ee service nova] Creating event network-vif-plugged:90a831be-ee4a-48e5-8fa1-6065a15c36e6 for instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 on hv-cinder-84617 Jul 18 10:49:31.640789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-5a4bdfaf-10a0-46a9-a7bd-55c54cd6ba34 req-6468fe46-7df3-4813-b3c3-543800a3b2ee service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Jul 18 10:49:31.641367 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 447/881] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:32.260806 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:32.261420 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:32.268198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.268651 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.269455 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.269890 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.427725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:32.429344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:32.438107 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.438699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.439898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.440543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.658365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:32.666416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:32.671819 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:32.673866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:32.674974 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad6cd56b-733e-4caa-b3b2-1279558ded4a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.254019 Jul 18 10:49:32.675236 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d46e091-68be-40f2-bccd-feca791553e5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1720 microversion: 2.20 time: 0.419541 Jul 18 10:49:32.675946 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 435/882] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:32 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1720 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:32.685342 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 448/883] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:32 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:32.686149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "374b2ef6-643f-4df8-86fb-132638489196"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:32.687299 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:32.694042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.694502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.695273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:32.695707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:32.712587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:33.693398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:33.694234 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:33.700873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.702588 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.703378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.704087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.722470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-059affdd-76bd-4663-b119-c82a9b8754ba tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.044610 Jul 18 10:49:33.722994 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 436/884] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:32 2022] POST /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 194 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:33.741653 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:33.742942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:33.757739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.764540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.764540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:33.764540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:33.922896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:33.931007 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d93f56be-505b-431b-8e2a-0bfd93bf7944 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1368 microversion: 2.1 time: 0.242030 Jul 18 10:49:33.936108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 449/885] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:33 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1368 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:49:33.959940 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:33.968273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:33.972356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:33.973839 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dea105c4-cc6e-4417-90fc-5b525c7ab241 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1720 microversion: 2.20 time: 0.249635 Jul 18 10:49:33.975237 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 437/886] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:33 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1720 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:34.951043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:34.951769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:34.959140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:34.968858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:34.968858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:34.968858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:34.993326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:34.993940 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:35.000404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.000995 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.001771 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.002208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.150271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.157714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-473c7e18-a76f-45a8-876a-f2f27787b432 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1558 microversion: 2.1 time: 0.214215 Jul 18 10:49:35.158277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 450/887] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:49:34 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:49:35.173779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:35.174301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:35.179250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.181518 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.181968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.182747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:35.183174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:35.187189 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.188939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:35.190100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9435b504-d8bd-4153-a84b-e7d05cbbcc84 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1720 microversion: 2.20 time: 0.201330 Jul 18 10:49:35.190642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 438/888] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:34 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1720 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:35.268995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc618000-4132-4384-b955-409a69c48713 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098813 Jul 18 10:49:35.269578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 451/889] 10.222.0.47 () {58 vars in 1274 bytes} [Mon Jul 18 10:49:35 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:49:36.210162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:36.210786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:36.218542 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.219268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.220196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.220820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.660311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-eeaa7abd-dace-4fdb-97b0-1d0c4860ae68 req-8a034aba-e7b7-405c-8b78-4f20ed9e7234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a86c322-9d0a-4c46-824b-b8cfb0366af4", "tag": "90a831be-ee4a-48e5-8fa1-6065a15c36e6"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:36.671369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-eeaa7abd-dace-4fdb-97b0-1d0c4860ae68 req-8a034aba-e7b7-405c-8b78-4f20ed9e7234 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.678976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-eeaa7abd-dace-4fdb-97b0-1d0c4860ae68 req-8a034aba-e7b7-405c-8b78-4f20ed9e7234 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.685738 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.688492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-eeaa7abd-dace-4fdb-97b0-1d0c4860ae68 req-8a034aba-e7b7-405c-8b78-4f20ed9e7234 service nova] Creating event network-changed:90a831be-ee4a-48e5-8fa1-6065a15c36e6 for instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 on hv-cinder-84617 Jul 18 10:49:36.694803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-eeaa7abd-dace-4fdb-97b0-1d0c4860ae68 req-8a034aba-e7b7-405c-8b78-4f20ed9e7234 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038186 Jul 18 10:49:36.695715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 452/890] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:36.699181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.700778 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:36.702023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-830f745f-d4a5-4fcd-8b32-72ba18a48e9a tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1723 microversion: 2.20 time: 0.496516 Jul 18 10:49:36.702565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 439/891] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:36 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1723 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:36.722531 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def2c948-083a-4d0b-af68-a9b6d8589afb"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:36.725125 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:36.734089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.734603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:36.735393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:36.735840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.584494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-19b250c1-cae3-4f38-8e1f-418c3ad55e74 req-b30341c4-e03c-4904-92f0-3db11203c697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "name": "network-vif-unplugged", "status": "completed", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:37.593951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-19b250c1-cae3-4f38-8e1f-418c3ad55e74 req-b30341c4-e03c-4904-92f0-3db11203c697 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:37.593951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-19b250c1-cae3-4f38-8e1f-418c3ad55e74 req-b30341c4-e03c-4904-92f0-3db11203c697 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:37.605932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.compute.server_external_events [req-19b250c1-cae3-4f38-8e1f-418c3ad55e74 req-b30341c4-e03c-4904-92f0-3db11203c697 service nova] Unable to find a host for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664. Dropping event network-vif-unplugged {{(pid=124844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 10:49:37.606796 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-19b250c1-cae3-4f38-8e1f-418c3ad55e74 req-b30341c4-e03c-4904-92f0-3db11203c697 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026972 Jul 18 10:49:37.607359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 440/892] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 10:49:38.004191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3e39dc90-ff5b-49a6-8ec8-b4eb4ab15b7d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.286531 Jul 18 10:49:38.006083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 453/893] 10.222.0.47 () {62 vars in 1363 bytes} [Mon Jul 18 10:49:36 2022] POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments => generated 188 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 10:49:38.122902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:38.123585 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.135353 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.136016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.136924 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.137463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.928708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-801db068-3f1f-4980-a2d8-24b7c5ef7d03 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments/def2c948-083a-4d0b-af68-a9b6d8589afb" status: 202 len: 0 microversion: 2.20 time: 0.811372 Jul 18 10:49:38.929699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 441/894] 10.222.0.47 () {60 vars in 1456 bytes} [Mon Jul 18 10:49:38 2022] DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments/def2c948-083a-4d0b-af68-a9b6d8589afb => generated 0 bytes in 813 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 10:49:38.990409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:38.990980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:38.998161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.998623 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:38.999395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:38.999832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.310315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f5a65ff4-6dc2-4d1c-a3c3-c0773f72a3b5 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/action" status: 202 len: 0 microversion: 2.20 time: 0.324361 Jul 18 10:49:39.310974 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 454/895] 10.222.0.47 () {62 vars in 1318 bytes} [Mon Jul 18 10:49:38 2022] POST /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/action => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:49:39.319362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:39.319975 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:39.329716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.329716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.329716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:39.329716 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:39.477365 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.485294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.486803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:39.487950 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a58606b3-f562-414b-a9cc-3132a21e30ff tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1671 microversion: 2.20 time: 0.172827 Jul 18 10:49:39.488871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 442/896] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:39 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:40.514854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:40.515623 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:40.523887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.524409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.525295 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:40.525803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:40.663023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.672991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.674633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:40.675858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ec442852-d450-4fc9-8588-95074faf89aa tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1671 microversion: 2.20 time: 0.172491 Jul 18 10:49:40.676505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 455/897] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:40 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1671 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:41.713204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:41.713204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:41.713204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.713204 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.713984 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:41.713984 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:41.855373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:41.864650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:41.865369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:41.866532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5ada4c1b-38ff-449c-b1fa-82bf7ae9c828 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1673 microversion: 2.20 time: 0.176243 Jul 18 10:49:41.867083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 443/898] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:41 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1673 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:42.886146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:42.886756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:42.890575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:42.894082 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.900054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:42.900054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:42.900054 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.080774 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.089071 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.090561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:43.091750 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc6fac59-7ba9-479b-81f8-309da7d0bb9d tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.209555 Jul 18 10:49:43.092312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 456/899] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:42 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:43.539650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:43.541394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:43.548723 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.549426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.550198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.550790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.580912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d291af33-8899-47d8-8f84-2d2bd4e87b3a tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Jul 18 10:49:43.581756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 444/900] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:49:43 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:43.594934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:43.594934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:43.623001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.623727 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.625527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:43.626321 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:43.664447 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4a1bb84b-6237-4355-bb5e-b60c8e907e17 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196" status: 200 len: 194 microversion: 2.1 time: 0.074849 Jul 18 10:49:43.683043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 457/901] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Jul 18 10:49:43 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:44.111207 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:44.111887 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:44.135153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:44.135153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:44.135153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:44.135153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:44.321177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:44.332064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:44.334929 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:44.336511 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-82e339af-823f-4057-ac69-7d2b9e3ef726 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.229508 Jul 18 10:49:44.338287 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 445/902] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:44 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:45.358957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:45.360738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.371762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.373309 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.374464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.375669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.401545 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:45.560011 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.569028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.570559 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:45.571718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-96ad7c99-bdd1-4819-8acd-b9ad618040ab tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.218019 Jul 18 10:49:45.572272 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 458/903] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:45 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:45.829153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4a9a3a8-173b-4828-a967-1b3e37332d6b"}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:45.831066 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:45.840891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.841348 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:45.843211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:45.843660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:46.591024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:46.592395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:46.603880 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:46.604820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:46.605557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:46.605751 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:46.820804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:46.832073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:46.834840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:46.836271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dab60c52-36f8-4bec-a23c-1ac474dec1e6 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.249801 Jul 18 10:49:46.846732 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 459/904] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:46 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:47.856219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:47.857066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:47.863485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.863888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:47.864642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:47.865217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:48.017677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:48.027711 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:48.029397 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:48.030675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3bc6252b-d637-4d9d-b918-b29b8f79fb8b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.179128 Jul 18 10:49:48.031298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 460/905] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:47 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:49.050475 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:49.052376 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:49.059931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.060464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.061350 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:49.062006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:49.272621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.272621 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.273340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:49.273340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-40187dc7-f471-423e-9d2d-9fee27c1e087 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.222621 Jul 18 10:49:49.273340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 461/906] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:49 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:50.295408 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:50.300394 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:50.303468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.303923 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.304753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:50.305355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:50.465935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.476217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.477744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:50.478906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c128220f-37ea-4520-b3ef-a2db03d78581 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.187475 Jul 18 10:49:50.479457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 462/907] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:50 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:51.498478 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:51.499324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:51.506197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.506655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.507897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:51.508513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:51.674935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:51.684023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:51.686028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:51.687641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-39d29d16-185c-46b9-90f6-098842a47218 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.193631 Jul 18 10:49:51.700045 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 463/908] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:51 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:52.707018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:52.707975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:52.714135 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.714581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.715369 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:52.715801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:52.846258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.855143 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.856640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:52.857820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4d9d84fe-3f6f-48f0-8265-173ff2892403 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.154969 Jul 18 10:49:52.858473 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 464/909] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:52 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:53.875961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:53.876674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:53.883411 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.883853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:53.884613 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:53.885076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:54.017022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.025644 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.027157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:54.028306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-65001087-f552-4f8b-9d2b-278389361587 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.156207 Jul 18 10:49:54.028987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 465/910] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:53 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:49:54.294751 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a393a7f4-1784-4e5a-aaca-ebc4f692d790 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "POST /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.469596 Jul 18 10:49:54.299893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 446/911] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:49:45 2022] POST /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 194 bytes in 8471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:55.047479 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:55.048085 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:55.054639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.055177 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.055939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:55.056375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:55.191381 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.200882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.202643 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:55.204069 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-90e1c973-8539-45a1-b585-a71432ad636f tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.160366 Jul 18 10:49:55.204608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 466/912] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:55 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:56.220659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=25 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:56.225459 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:56.226156 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:56.232145 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:56.233579 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:56.233579 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:56.233790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:56.367645 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:56.375647 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:56.377198 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:56.378356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ffee29a4-58ca-46a2-a26f-8cca268a22c4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.159134 Jul 18 10:49:56.378927 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 447/913] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:56 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:57.397002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:57.397539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:57.403923 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:57.404366 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:57.405179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:57.405607 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:57.565640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.565640 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.565964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:57.565964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bdd145f3-09a9-44d5-b014-86cd07ba4cd2 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.161278 Jul 18 10:49:57.565964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 467/914] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:57 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:57.612377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-a5110539-a3fa-42a1-9d9a-4044a7c3d4d7 req-5d7b6775-84c6-4634-a2ff-5dbc6e84989e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "name": "network-vif-plugged", "status": "completed", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:49:57.617231 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a5110539-a3fa-42a1-9d9a-4044a7c3d4d7 req-5d7b6775-84c6-4634-a2ff-5dbc6e84989e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:57.617679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a5110539-a3fa-42a1-9d9a-4044a7c3d4d7 req-5d7b6775-84c6-4634-a2ff-5dbc6e84989e service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:57.628972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-a5110539-a3fa-42a1-9d9a-4044a7c3d4d7 req-5d7b6775-84c6-4634-a2ff-5dbc6e84989e service nova] Creating event network-vif-plugged:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:49:57.634383 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-a5110539-a3fa-42a1-9d9a-4044a7c3d4d7 req-5d7b6775-84c6-4634-a2ff-5dbc6e84989e service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032827 Jul 18 10:49:57.634969 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 448/915] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:49:58.582825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:58.583432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:58.589905 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:58.590355 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:58.591114 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:58.591557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:58.725327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.733400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.734967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:58.736180 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2ac7caf3-4a57-46a4-b8c0-f916e3ca60f9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.157581 Jul 18 10:49:58.736744 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 468/916] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:58 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:49:59.757114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:49:59.757840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:49:59.764106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:59.764559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:59.765367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:49:59.765807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:49:59.783737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:49:59.906245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:59.919358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:59.919358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:49:59.919358 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-63f38be6-e814-4063-8f88-2a20fea0abc4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.167060 Jul 18 10:49:59.920076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 449/917] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:49:59 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:00.937286 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:00.937832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:00.944546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:00.945051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:00.945933 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:00.946371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:01.083130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.094353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.094353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:01.094353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-cc44b885-1282-47f3-9fbb-8b21acdb1d73 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1729 microversion: 2.20 time: 0.160848 Jul 18 10:50:01.094940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 469/918] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:00 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:02.114156 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:02.114822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:02.122005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.122457 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.123224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.123659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.254484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.262672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.264173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:02.265373 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f465fc02-4f24-4a0b-8943-6eac7ac4b004 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1716 microversion: 2.20 time: 0.155771 Jul 18 10:50:02.265932 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 450/919] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:02 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:02.854052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:02.855146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:02.861871 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.862430 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.863961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:02.864406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:02.893974 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-45044447-692d-4eaf-8365-0b1ada37bb3f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043882 Jul 18 10:50:02.894526 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 470/920] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:02 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:03.032031 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:03.037210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:03.039798 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:03.040249 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:03.041043 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:03.041483 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:03.069135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-57526ba5-98f3-4217-9e68-22c127987848 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196" status: 200 len: 194 microversion: 2.1 time: 0.041033 Jul 18 10:50:03.069704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 451/921] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Jul 18 10:50:03 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:03.079470 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:03.079963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:03.086558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:03.087002 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:03.087758 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:03.088194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:03.166747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lazy-loading 'services' on Instance uuid ecbe51a1-543e-434e-8d6e-42c2b6a71a4e {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:03.403773 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2a13d0ac-9e88-446c-977f-0dc347f71d19 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196" status: 202 len: 0 microversion: 2.1 time: 0.328223 Jul 18 10:50:03.404408 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 471/922] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:50:03 2022] DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/374b2ef6-643f-4df8-86fb-132638489196 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:05.576354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:05.576877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:05.584540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.584998 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.585744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.586172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.613919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4c7abaa1-cf20-46d5-b36e-520e5b0e9844 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/e4a9a3a8-173b-4828-a967-1b3e37332d6b" status: 200 len: 194 microversion: 2.1 time: 0.041855 Jul 18 10:50:05.614413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 452/923] 10.222.0.47 () {58 vars in 1412 bytes} [Mon Jul 18 10:50:05 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/e4a9a3a8-173b-4828-a967-1b3e37332d6b => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:05.624969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:05.625592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:05.633301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.633752 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.634513 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:05.634951 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:05.718682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lazy-loading 'services' on Instance uuid ecbe51a1-543e-434e-8d6e-42c2b6a71a4e {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:06.018225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bfd93d93-a476-490e-96e0-877de4b2afe6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/e4a9a3a8-173b-4828-a967-1b3e37332d6b" status: 202 len: 0 microversion: 2.1 time: 0.397488 Jul 18 10:50:06.018820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 472/924] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:50:05 2022] DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments/e4a9a3a8-173b-4828-a967-1b3e37332d6b => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:08.241704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:08.242762 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:08.249344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.249873 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.250727 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.251273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.281756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d260bc7a-2646-4c91-aea7-58d112463a37 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044113 Jul 18 10:50:08.282318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 453/925] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:08 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:50:08.389505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:08.390532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:08.397402 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.397853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.398616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.399053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.424296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:08.429375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fd7a2f1d-eba1-4384-b02e-04e6da0348a6 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044581 Jul 18 10:50:08.429746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 473/926] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:08 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:50:08.491721 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:08.496106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:08.498661 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.499114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.499891 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.500327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.526050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:50:08.918436 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-458f8d1c-3c9c-4bca-bc1a-1d676488f311 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 204 len: 0 microversion: 2.1 time: 0.430799 Jul 18 10:50:08.919027 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 454/927] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:08 2022] DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:50:08.927241 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:08.927789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:08.934489 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.934939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:08.935693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:08.936128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:09.069897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:09.077322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a15975fc-240f-40c5-886a-4bef4181e003 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1675 microversion: 2.1 time: 0.153907 Jul 18 10:50:09.077894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 474/928] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:08 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:10.096060 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:10.096789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:10.103537 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:10.105676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:10.105676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:10.105676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:10.237637 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:10.247134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-be56216d-8e20-421d-9bbf-8a0b3690fb84 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1675 microversion: 2.1 time: 0.155185 Jul 18 10:50:10.251465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 455/929] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:10 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:11.264750 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:11.265444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:11.273352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:11.273798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:11.274556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:11.274985 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:11.421670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:11.429845 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-018646c1-5b50-4051-a11f-d55956a78ef7 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1675 microversion: 2.1 time: 0.168996 Jul 18 10:50:11.432501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 475/930] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:11 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:12.015758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-af8bdece-3462-454e-abbd-9f434e582f23 req-6d7e12c4-f01b-4aa2-b49a-2f1658116dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecbe51a1-543e-434e-8d6e-42c2b6a71a4e", "name": "network-vif-deleted", "tag": "ef32bab6-9d9d-49a6-9432-3d3fc89864a3"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:12.025001 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-af8bdece-3462-454e-abbd-9f434e582f23 req-6d7e12c4-f01b-4aa2-b49a-2f1658116dcd service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.025443 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-af8bdece-3462-454e-abbd-9f434e582f23 req-6d7e12c4-f01b-4aa2-b49a-2f1658116dcd service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.037281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-af8bdece-3462-454e-abbd-9f434e582f23 req-6d7e12c4-f01b-4aa2-b49a-2f1658116dcd service nova] Creating event network-vif-deleted:ef32bab6-9d9d-49a6-9432-3d3fc89864a3 for instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e on hv-cinder-84617 Jul 18 10:50:12.042437 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-af8bdece-3462-454e-abbd-9f434e582f23 req-6d7e12c4-f01b-4aa2-b49a-2f1658116dcd service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030400 Jul 18 10:50:12.043033 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 456/931] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:50:12.455092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:12.455706 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:12.463293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.464036 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.465125 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.465654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.501549 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.502094 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.502765 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lazy-loading 'fault' on Instance uuid ecbe51a1-543e-434e-8d6e-42c2b6a71a4e {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:12.564813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17e0c6def385441bbdde18c63b7d99e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e4aa903be8d4afc91f368051333848b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:12.573361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-bc9b18ea-c82d-4767-a5e5-b800e9db7cff tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 200 len: 1327 microversion: 2.1 time: 0.122276 Jul 18 10:50:12.574200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 476/932] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:12 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:12.929893 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:12.930793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:12.937356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.937879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.938782 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:12.939294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:12.972375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8b9e8429-80bd-4d48-83d9-1fba6adbbc52 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/ips" status: 200 len: 149 microversion: 2.1 time: 0.046906 Jul 18 10:50:12.973866 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 457/933] 10.222.0.47 () {58 vars in 1247 bytes} [Mon Jul 18 10:50:12 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:13.591179 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:13.591792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:13.606527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:13.606527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:13.606527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:13.606527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:13.615872 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e HTTP/1.1 Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:13.617581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:13.619424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'ecbe51a1-543e-434e-8d6e-42c2b6a71a4e'} Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:13.620225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:13.621609 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:13.623406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:13.623406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8769f48d-7aea-4eb9-81d7-8667a4e83d91 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 404 len: 111 microversion: 2.1 time: 0.031735 Jul 18 10:50:13.623406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 477/934] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:13 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:13.628226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-daeb3123-10f6-40da-a4be-d105cb401cbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '.version_select at 0x7f5f0a5e6040>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:13.792414 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-daeb3123-10f6-40da-a4be-d105cb401cbd tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792368706" status: 202 len: 0 microversion: 2.1 time: 0.167889 Jul 18 10:50:13.793053 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 458/935] 10.222.0.47 () {58 vars in 1220 bytes} [Mon Jul 18 10:50:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1792368706 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:14.666934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bbe9ff37-3fd3-4ea2-9c39-b52e27784374"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:14.668059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:14.674739 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:14.675122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:14.675969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:14.676614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:15.825716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e56c6b98-d288-4b9b-b554-e1208aeaf8e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "POST /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.162450 Jul 18 10:50:15.826413 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 478/936] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:50:14 2022] POST /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments => generated 194 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:17.367783 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:17.371187 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:17.376548 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.377130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.377972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.378783 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.393053 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e HTTP/1.1 Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:17.395713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.397354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'ecbe51a1-543e-434e-8d6e-42c2b6a71a4e'} Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:17.398166 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.399660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.401691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:17.402712 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-29f4308e-57f6-4f3a-888d-928df8fa5bf1 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 404 len: 111 microversion: 2.1 time: 0.039733 Jul 18 10:50:17.414386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 459/937] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:17 2022] DELETE /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:17.414855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:17.414855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: ecbe51a1-543e-434e-8d6e-42c2b6a71a4e] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:17.416942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=48 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:17.422020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.422581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.423499 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:17.424025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:17.440035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e HTTP/1.1 Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:17.442267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.443835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'ecbe51a1-543e-434e-8d6e-42c2b6a71a4e'} Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:17.444860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. Jul 18 10:50:17.446260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:17.447552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance ecbe51a1-543e-434e-8d6e-42c2b6a71a4e could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:17.447552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-93e7405c-db2b-4fdc-9b97-310c9329bf83 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e" status: 404 len: 111 microversion: 2.1 time: 0.037565 Jul 18 10:50:17.447552 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 479/938] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:17 2022] GET /compute/v2.1/servers/ecbe51a1-543e-434e-8d6e-42c2b6a71a4e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:18.757782 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:18.758389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:18.767179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.770150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:18.771266 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.771949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:18.799477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 HTTP/1.1 Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:18.801708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.803048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f01418be-d04a-4364-94f0-5c85f9244d63'} Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:18.803766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.811298 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.813377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:18.813377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0791d75e-16be-40d8-a6fa-ef9f8d5489e5 tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 404 len: 111 microversion: 2.1 time: 0.053353 Jul 18 10:50:18.813377 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 460/939] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:18 2022] DELETE /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:18.819221 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:18.826676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] [instance: f01418be-d04a-4364-94f0-5c85f9244d63] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:18.843954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.845939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:18.846924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:18.848118 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:18.864571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] HTTP exception thrown: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Request method failure captured: Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 HTTP/1.1 Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlJbAp-Gce5exltHiL6OHX0KdeKCblNpB3EO7v1OdhTasI4Ae4kwq8sb4-gZQyIYZLV4S6hXh3vmxjc1RDICBEKSH5tLwSWt0UCziRhGGPoE1ArXfm7hTODzoCJa7pGheR2tUWGcO8ry1dfRCSBTGqFeJTemJHyWl9yKZPdCRWc6zM Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:18.866169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_9e4aa903be8d4afc91f368051333848b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/9e4aa903be8d4afc91f368051333848b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/9e4aa903be8d4afc91f368051333848b"}]}] Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 9e4aa903be8d4afc91f368051333848b Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeTestJSON-743420978 Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 17e0c6def385441bbdde18c63b7d99e3 Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeTestJSON-743420978-project Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.867457 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'f01418be-d04a-4364-94f0-5c85f9244d63'} Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:18.868225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. Jul 18 10:50:18.869540 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:18.870698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] Returning 404 to user: Instance f01418be-d04a-4364-94f0-5c85f9244d63 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:18.870698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-12a8b681-19b8-4b23-ad2b-c2ac8dd8fb9f tempest-AttachVolumeTestJSON-743420978 tempest-AttachVolumeTestJSON-743420978-project] 10.222.0.47 "GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63" status: 404 len: 111 microversion: 2.1 time: 0.052893 Jul 18 10:50:18.877092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 480/940] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:18 2022] GET /compute/v2.1/servers/f01418be-d04a-4364-94f0-5c85f9244d63 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:23.690171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:23.690717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:23.697659 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:23.698136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:23.699113 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:23.699559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:23.823350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'services' on Instance uuid 5a86c322-9d0a-4c46-824b-b8cfb0366af4 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:24.101195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1447f779-9960-4a5c-a166-52ad817651a6 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments/bbe9ff37-3fd3-4ea2-9c39-b52e27784374" status: 202 len: 0 microversion: 2.1 time: 0.415061 Jul 18 10:50:24.104196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 461/941] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:50:23 2022] DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments/bbe9ff37-3fd3-4ea2-9c39-b52e27784374 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:24.110278 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:24.111791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:24.118802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:24.119256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:24.120024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:24.120601 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:24.150984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-30e76b47-5b26-4e2d-92b0-d9fa9ac7ea65 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Jul 18 10:50:24.151557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 481/942] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:24 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:25.170949 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:25.174140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:25.192260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.193176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.194285 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:25.194938 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:25.297642 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-dae50e2e-44d8-4969-baf9-709554b9ef16 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137487 Jul 18 10:50:25.299460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 462/943] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:25 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments => generated 197 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:26.310718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:26.311786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:26.319961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:26.322789 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:26.323658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:26.324099 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:26.367463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33d8498a-c38e-4dcd-9833-aa20089a4f0a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061013 Jul 18 10:50:26.368476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 482/944] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:50:26 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 10:50:26.469450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:26.470036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:26.473125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:26.482018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:26.488036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:26.488036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:26.488036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:26.545974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:50:27.014973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c85542d2-ded1-4563-a507-a3198196ee1a tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 204 len: 0 microversion: 2.1 time: 0.548878 Jul 18 10:50:27.015557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 463/945] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:26 2022] DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:50:27.026289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:27.027029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:27.036862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.037383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.038223 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:27.038726 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:27.227973 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:27.238170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc12268d-71f1-4db6-8b43-345e5729c5f8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1682 microversion: 2.1 time: 0.216006 Jul 18 10:50:27.238772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 483/946] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:27 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:27.983080 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-161834d1-2dc4-4f88-980a-fd348659f69b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Action: 'create', calling method: .version_select at 0x7f5f0a6a5ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-704550812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMJgHZmG/xd9H4xdEG8IO1+UTFS7ANTHqct7BNnCt7ZURmX7FmQex8TE3jNsNowQYuC2QXp+qsdPQs0beocwtVPTDGgFOHEX3JFaFhLQCctVWXsSPJb81SdYHjJ5+R0WA=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:28.009880 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-161834d1-2dc4-4f88-980a-fd348659f69b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for project 5d7ee0634e694265868916311d7fb4f1. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:50:28.015830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-161834d1-2dc4-4f88-980a-fd348659f69b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for user cf3fce0b778f46df844a6be985c28b09 and project 5d7ee0634e694265868916311d7fb4f1. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:50:28.125617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-161834d1-2dc4-4f88-980a-fd348659f69b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.348440 Jul 18 10:50:28.126207 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 464/947] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:50:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:28.257496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:28.258487 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:28.267591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.268126 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.269062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:28.269899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:28.439171 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:28.447735 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-152c0a72-9891-4edd-af07-b17b989e8380 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1682 microversion: 2.1 time: 0.196129 Jul 18 10:50:28.448292 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 484/948] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:28 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:29.465200 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:29.466026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:29.477363 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.477879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:29.478727 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.479232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:29.549280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:29.564329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-9a3e4ac6-7833-4cb5-8a40-395484e3a970 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1614 microversion: 2.1 time: 0.103331 Jul 18 10:50:29.565025 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 465/949] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:29 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1614 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:29.887198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-25cac0eb-367e-4d44-993d-6f29da2300df req-8c052e32-8d14-4c07-8f05-efba1ba7423b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a86c322-9d0a-4c46-824b-b8cfb0366af4", "name": "network-vif-deleted", "tag": "90a831be-ee4a-48e5-8fa1-6065a15c36e6"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:29.900735 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-25cac0eb-367e-4d44-993d-6f29da2300df req-8c052e32-8d14-4c07-8f05-efba1ba7423b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:29.901173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-25cac0eb-367e-4d44-993d-6f29da2300df req-8c052e32-8d14-4c07-8f05-efba1ba7423b service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:29.919677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-25cac0eb-367e-4d44-993d-6f29da2300df req-8c052e32-8d14-4c07-8f05-efba1ba7423b service nova] Creating event network-vif-deleted:90a831be-ee4a-48e5-8fa1-6065a15c36e6 for instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 on hv-cinder-84617 Jul 18 10:50:29.937537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-25cac0eb-367e-4d44-993d-6f29da2300df req-8c052e32-8d14-4c07-8f05-efba1ba7423b service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043661 Jul 18 10:50:29.958512 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 485/950] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:30.587306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:30.588606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:30.602104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.602657 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.603908 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.604810 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.634008 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:30.648885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:30.649651 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:30.650867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lazy-loading 'fault' on Instance uuid 5a86c322-9d0a-4c46-824b-b8cfb0366af4 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:30.697531 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46d0d621460b4e5b877ef421d3503340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76bdb50a5c540e9aeb2099b993d334b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:30.705332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c8d8067a-19e1-4533-823b-9f49dc82283e tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 200 len: 1332 microversion: 2.1 time: 0.127285 Jul 18 10:50:30.705919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 466/951] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:30 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:31.730393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:31.731716 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:31.739031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.739878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.741576 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:31.742697 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:31.760153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 HTTP/1.1 Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:31.761891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:31.764360 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '5a86c322-9d0a-4c46-824b-b8cfb0366af4'} Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:31.765375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:31.766686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:31.767867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:31.767867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f40220fa-c98e-4dee-a770-82dfa7a66eb8 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 404 len: 111 microversion: 2.1 time: 0.043989 Jul 18 10:50:31.767867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 486/952] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:31 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:31.772767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f85b76b5-d089-42d9-8d0b-07bafe2fd742 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '.version_select at 0x7f5f0a544040>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:31.863155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f85b76b5-d089-42d9-8d0b-07bafe2fd742 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207779590" status: 202 len: 0 microversion: 2.1 time: 0.094051 Jul 18 10:50:31.863947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 467/953] 10.222.0.47 () {58 vars in 1220 bytes} [Mon Jul 18 10:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1207779590 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:50:34.075791 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:34.076322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:34.084967 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.085348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.086185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.086618 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.101195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 HTTP/1.1 Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:34.102755 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.104170 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '5a86c322-9d0a-4c46-824b-b8cfb0366af4'} Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:34.104975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.106187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.108655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:34.109550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-336cb1ad-36eb-40d4-98c6-a9901caecc37 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 404 len: 111 microversion: 2.1 time: 0.038113 Jul 18 10:50:34.110194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 487/954] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:34 2022] DELETE /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:50:34.119674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:34.120293 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 5a86c322-9d0a-4c46-824b-b8cfb0366af4] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:34.126807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.127261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.128797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:34.129380 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:34.144378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 HTTP/1.1 Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:34.146107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.147461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '5a86c322-9d0a-4c46-824b-b8cfb0366af4'} Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:34.148247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. Jul 18 10:50:34.150250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:34.152091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 5a86c322-9d0a-4c46-824b-b8cfb0366af4 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:34.152091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8d83ff1c-e8c8-43ae-bb3c-413be2603bfe tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4" status: 404 len: 111 microversion: 2.1 time: 0.032952 Jul 18 10:50:34.152091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 468/955] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:34 2022] GET /compute/v2.1/servers/5a86c322-9d0a-4c46-824b-b8cfb0366af4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:35.033092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.034051 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.040837 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.041288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.042068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.042508 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.075035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5dfedc16-42fd-4824-b2b6-17e1b5d98843 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046479 Jul 18 10:50:35.075930 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 488/956] 10.222.0.47 () {60 vars in 1342 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:35.145740 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.146503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.153154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.153621 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.154406 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.154836 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.180595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:50:35.491123 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.491624 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.498614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.499072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.500232 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.500700 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.514814 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f HTTP/1.1 Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:35.518525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.520122 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f'} Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:35.521061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.522626 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.524084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:35.524084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7580c2ae-ff4d-46a9-87e7-06a46f06c4e3 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 404 len: 111 microversion: 2.1 time: 0.031109 Jul 18 10:50:35.524084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 489/957] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:35 2022] DELETE /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:50:35.526053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.526666 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.532495 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.533120 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.534414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.534870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.548500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f HTTP/1.1 Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:35.550761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.552357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f'} Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:35.553255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. Jul 18 10:50:35.562485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.563785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:35.563785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-01b15722-b557-4a1b-9bb2-de324c3d20b0 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f" status: 404 len: 111 microversion: 2.1 time: 0.029856 Jul 18 10:50:35.563785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 490/958] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/25b38cb6-3d4b-4d2e-8d56-eda1c8c08e8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:50:35.564032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c163e85c-9d6a-48ca-a9b4-8d4c76618aa4 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 204 len: 0 microversion: 2.20 time: 0.410829 Jul 18 10:50:35.564032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 469/959] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Jul 18 10:50:35 2022] DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 10:50:35.564202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.564202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.564385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.564385 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.568594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.569130 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.569902 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.570351 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.570530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.570996 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.571788 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.572223 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.585879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 HTTP/1.1 Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:35.587424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a9a657a9-33a7-4766-8064-5084f549db71'} Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:35.592989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.594421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.595890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:35.595890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2de37c53-539f-409b-a68d-19bcd49c6c73 tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 404 len: 111 microversion: 2.1 time: 0.031057 Jul 18 10:50:35.595890 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 491/960] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:35 2022] DELETE /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:35.601984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:35.602731 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: a9a657a9-33a7-4766-8064-5084f549db71] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:35.611206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.611655 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.613340 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:35.613795 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:35.629598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 HTTP/1.1 Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:35.631128 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.632670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a9a657a9-33a7-4766-8064-5084f549db71'} Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:35.636722 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. Jul 18 10:50:35.638168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:35.639650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance a9a657a9-33a7-4766-8064-5084f549db71 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:35.639650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7641d984-905d-4735-9ee8-e62fb38aaedf tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71" status: 404 len: 111 microversion: 2.1 time: 0.034542 Jul 18 10:50:35.639650 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 492/961] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/a9a657a9-33a7-4766-8064-5084f549db71 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:50:35.738349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.749812 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.751419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:35.753107 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f452ec0a-d762-4e3d-96bd-b0426cbaf366 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.193631 Jul 18 10:50:35.753682 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 470/962] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:35 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:36.772398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:36.773197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:36.780674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.781314 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.782099 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.782534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:36.931782 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:36.941798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:36.943364 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:36.944564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f209341e-1ba9-480d-bf09-ad8895f02ad9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1722 microversion: 2.20 time: 0.176837 Jul 18 10:50:36.945146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 493/963] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:36 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:36.991516 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:36.992167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:36.999054 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:36.999502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.000412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.000986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.015374 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 HTTP/1.1 Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:37.017326 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.018701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '6158dc6a-973a-4cad-b71a-e607de559786'} Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:37.020378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.022090 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.023860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:37.023860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6ae0af1c-a171-434c-a1ca-aa9de91456bd tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 404 len: 111 microversion: 2.1 time: 0.031945 Jul 18 10:50:37.023860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 471/964] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:50:36 2022] DELETE /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:37.030517 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:37.041603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] [instance: 6158dc6a-973a-4cad-b71a-e607de559786] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:37.041603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.041603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.041603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.042023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.054995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] HTTP exception thrown: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Request method failure captured: Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 HTTP/1.1 Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGn6E7-jBhWAUhmqrhlFdFZWEK4DlFlTQG-jKBWRIpKsaPX2rTTzz7cssc8Ic-CF9f7CXQk400C40Y7q-n9O5GofI76qf8J8-WBycofNgYuPiw1VkQN0PS9oKP68Z2cU7fsSbB6Mw5xq8weyOyGRsP4Y2HgEWFSybb5quEQ01NyoU Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:37.056635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/f76bdb50a5c540e9aeb2099b993d334b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/f76bdb50a5c540e9aeb2099b993d334b"}]}] Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: f76bdb50a5c540e9aeb2099b993d334b Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-563187507 Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 46d0d621460b4e5b877ef421d3503340 Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeNegativeTest-563187507-project Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.058248 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '6158dc6a-973a-4cad-b71a-e607de559786'} Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:37.059218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. Jul 18 10:50:37.060669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:37.061898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] Returning 404 to user: Instance 6158dc6a-973a-4cad-b71a-e607de559786 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:37.061898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6c69b8cc-3f5b-4516-829f-736b992aaf6b tempest-AttachVolumeNegativeTest-563187507 tempest-AttachVolumeNegativeTest-563187507-project] 10.222.0.47 "GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786" status: 404 len: 111 microversion: 2.1 time: 0.033703 Jul 18 10:50:37.061898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 494/965] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:37 2022] GET /compute/v2.1/servers/6158dc6a-973a-4cad-b71a-e607de559786 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:50:37.945664 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ecf92cb4-1e29-424b-81fa-886f9002e6fe req-98052653-af5e-481a-a9c7-119b23751330 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42cb3356-fc42-4e45-b81f-59e4d69fd664", "name": "network-vif-deleted", "tag": "6313a117-d452-4425-89a0-9d0a39855a64"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:37.961728 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ecf92cb4-1e29-424b-81fa-886f9002e6fe req-98052653-af5e-481a-a9c7-119b23751330 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.963135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ecf92cb4-1e29-424b-81fa-886f9002e6fe req-98052653-af5e-481a-a9c7-119b23751330 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:37.965547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:37.967241 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:37.979735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ecf92cb4-1e29-424b-81fa-886f9002e6fe req-98052653-af5e-481a-a9c7-119b23751330 service nova] Creating event network-vif-deleted:6313a117-d452-4425-89a0-9d0a39855a64 for instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 on hv-cinder-84617 Jul 18 10:50:37.992715 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ecf92cb4-1e29-424b-81fa-886f9002e6fe req-98052653-af5e-481a-a9c7-119b23751330 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049171 Jul 18 10:50:37.993260 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:37.994464 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 472/966] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:38.010120 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:38.012579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:38.015488 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:38.134839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.147200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.152839 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:38.155769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9b3d9d31-047a-4654-8e5d-534c83967f89 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1655 microversion: 2.20 time: 0.194780 Jul 18 10:50:38.157918 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 495/967] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:37 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1655 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 10:50:39.171544 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:39.176395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:39.177136 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:39.184344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.185050 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.186413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.186610 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.223213 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:39.223752 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:39.224218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lazy-loading 'fault' on Instance uuid 42cb3356-fc42-4e45-b81f-59e4d69fd664 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:50:39.319346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.328960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.330769 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df7a3101955b481f9a582168731ae76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad323d7f7c484b5bb161d92791c9c7d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:39.332157 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b8f6d2e2-07a7-47ba-9d27-db4d00ee959b tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 200 len: 1371 microversion: 2.20 time: 0.162015 Jul 18 10:50:39.334232 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 473/968] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:39 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 10:50:40.352005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:40.352807 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:40.361740 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.363106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.364092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:40.364535 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:40.367907 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:40.380645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 HTTP/1.1 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:40.382520 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:40.384521 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '42cb3356-fc42-4e45-b81f-59e4d69fd664'} Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:40.385467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:40.386725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:40.388021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:40.388021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9ea0d928-3529-46f8-90c4-f202f3569904 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 404 len: 111 microversion: 2.20 time: 0.036165 Jul 18 10:50:40.388021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 496/969] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:40 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:40.394580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5b2c8718-8bf8-4602-a600-97cfee347e4e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '.version_select at 0x7f5f0a9e1280>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:40.513663 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5b2c8718-8bf8-4602-a600-97cfee347e4e tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135740351" status: 204 len: 0 microversion: 2.20 time: 0.124579 Jul 18 10:50:40.516224 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 474/970] 10.222.0.47 () {60 vars in 1261 bytes} [Mon Jul 18 10:50:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2135740351 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 18 10:50:43.295419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:43.295961 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:43.304504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.304504 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.305291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.305718 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.319403 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 HTTP/1.1 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:43.322407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.323836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '42cb3356-fc42-4e45-b81f-59e4d69fd664'} Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:43.324927 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.326564 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.328169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:43.328169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-22264649-afa9-4bca-8f61-015db83c1d10 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 404 len: 111 microversion: 2.20 time: 0.032347 Jul 18 10:50:43.328169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 497/971] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Jul 18 10:50:43 2022] DELETE /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:43.334837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:43.335440 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: 42cb3356-fc42-4e45-b81f-59e4d69fd664] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:43.341613 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.342062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.352073 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:43.352073 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:43.357957 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 HTTP/1.1 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:43.359652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.361095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '42cb3356-fc42-4e45-b81f-59e4d69fd664'} Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:43.363857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. Jul 18 10:50:43.365676 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:43.367313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance 42cb3356-fc42-4e45-b81f-59e4d69fd664 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:43.367313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e683efa8-13aa-42b0-945d-39fa8167b8a9 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664" status: 404 len: 111 microversion: 2.20 time: 0.031720 Jul 18 10:50:43.367313 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 475/972] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:43 2022] GET /compute/v2.1/servers/42cb3356-fc42-4e45-b81f-59e4d69fd664 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:44.642483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:44.643661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.651525 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.652214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.652924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.653405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.668594 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 HTTP/1.1 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:50:44.670305 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.671982 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'f60e0663-4f73-4a3c-b76a-5e1c40a2b432'} Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:44.672848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.674083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.675327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:44.675327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6ba5f488-dd3f-4522-9449-b56382c9b172 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 404 len: 111 microversion: 2.20 time: 0.033891 Jul 18 10:50:44.675327 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 498/973] 10.222.0.47 () {60 vars in 1279 bytes} [Mon Jul 18 10:50:44 2022] DELETE /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:44.681400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:44.686675 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] [instance: f60e0663-4f73-4a3c-b76a-5e1c40a2b432] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:44.689550 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.690859 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.691786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:44.692226 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:44.708993 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] HTTP exception thrown: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Request method failure captured: Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 HTTP/1.1 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TlGtAI6pECI_7jfT9MATn0TwKcCNugYA6ox1SNDr8NGAK1Wx9Fhl1E0VKowCZz-iJGrXKO9mzVIB7_UO5P0pGLbRqGptvJTNhWtg0ftliGdpYt5ze63TMMKD0J_nUWj3Q1B05EhOqTKzFDltSeWHIggq_7dNP-T1sHPoCWvMjjg3J4 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:50:44.710744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/ad323d7f7c484b5bb161d92791c9c7d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/ad323d7f7c484b5bb161d92791c9c7d7"}]}] Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: ad323d7f7c484b5bb161d92791c9c7d7 Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-307782159 Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: df7a3101955b481f9a582168731ae76c Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-AttachVolumeShelveTestJSON-307782159-project Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.712404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'f60e0663-4f73-4a3c-b76a-5e1c40a2b432'} Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:50:44.713241 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. Jul 18 10:50:44.714515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:50:44.715686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] Returning 404 to user: Instance f60e0663-4f73-4a3c-b76a-5e1c40a2b432 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:50:44.715686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-32c9beac-23da-46e5-88c1-4375ea144085 tempest-AttachVolumeShelveTestJSON-307782159 tempest-AttachVolumeShelveTestJSON-307782159-project] 10.222.0.47 "GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432" status: 404 len: 111 microversion: 2.20 time: 0.035107 Jul 18 10:50:44.715686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 476/974] 10.222.0.47 () {60 vars in 1276 bytes} [Mon Jul 18 10:50:44 2022] GET /compute/v2.1/servers/f60e0663-4f73-4a3c-b76a-5e1c40a2b432 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 10:50:48.536159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-66521926", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704550812", "security_groups": [{"name": "tempest-secgroup-smoke-1348792654"}], "block_device_mapping_v2": [{"uuid": "b3c5c48c-e477-4d55-b4f1-5fdcdff584ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3d6ab3c-79a1-4e86-be98-5fb63570bf8f"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:48.693003 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] validate_networks() for [('a3d6ab3c-79a1-4e86-be98-5fb63570bf8f', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:50:48.900229 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=42 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:49.101851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:50:49.102273 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:50:49.102754 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:50:49.103153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:50:49.103568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:50:49.112658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.113138 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.113928 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:49.114561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:49.132025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:50:49.135913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for user cf3fce0b778f46df844a6be985c28b09 and project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:50:49.194662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:50:49.196931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3c5c48c-e477-4d55-b4f1-5fdcdff584ad',volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:50:49.659158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a53065a3-98de-49eb-9448-fc509af8fd4c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.128101 Jul 18 10:50:49.660764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 499/975] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:50:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:50:49.670958 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3c811aa9-0096-4eee-bc0d-8fe8c959a7b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:49.672137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3c811aa9-0096-4eee-bc0d-8fe8c959a7b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:49.770212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3c811aa9-0096-4eee-bc0d-8fe8c959a7b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:49.779608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3c811aa9-0096-4eee-bc0d-8fe8c959a7b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1092 microversion: 2.1 time: 0.112459 Jul 18 10:50:49.780211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 477/976] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:49 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1092 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:50.796218 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a18a5632-7f9d-4b8c-8e5d-b990ad3afc85 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:50.796860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a18a5632-7f9d-4b8c-8e5d-b990ad3afc85 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:50.853084 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a18a5632-7f9d-4b8c-8e5d-b990ad3afc85 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:50.859938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a18a5632-7f9d-4b8c-8e5d-b990ad3afc85 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1092 microversion: 2.1 time: 0.067592 Jul 18 10:50:50.860582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 500/977] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:50 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:51.878163 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:51.879846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:51.886546 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.887093 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.887870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:51.888330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:51.962407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:51.972332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8c88a490-5875-472e-8c32-8ed5bc4afe3c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1190 microversion: 2.1 time: 0.098027 Jul 18 10:50:51.973451 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 478/978] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:51 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1190 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:52.993471 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:52.994781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:53.009496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.012336 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.013465 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:53.014960 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:53.505556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:53.514800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-256f3498-4048-43e5-9bbd-9bbad651f491 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1276 microversion: 2.1 time: 0.526388 Jul 18 10:50:53.515370 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 501/979] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:52 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1276 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:54.539211 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:54.540552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2a05cb70-17f4-4d04-9eb2-d914fa787e79 req-e6372134-148f-4e2f-8386-4df389a4a1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f52ba8-7488-4dd3-9426-0407f2992a82", "tag": "eb4a055a-7e36-4f3c-abdd-b93788594154"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:50:54.550606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:54.571027 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.576530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.576723 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2a05cb70-17f4-4d04-9eb2-d914fa787e79 req-e6372134-148f-4e2f-8386-4df389a4a1b4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.576855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:54.576855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.577570 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2a05cb70-17f4-4d04-9eb2-d914fa787e79 req-e6372134-148f-4e2f-8386-4df389a4a1b4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:54.607528 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2a05cb70-17f4-4d04-9eb2-d914fa787e79 req-e6372134-148f-4e2f-8386-4df389a4a1b4 service nova] Creating event network-changed:eb4a055a-7e36-4f3c-abdd-b93788594154 for instance a0f52ba8-7488-4dd3-9426-0407f2992a82 on hv-cinder-84617 Jul 18 10:50:54.614781 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2a05cb70-17f4-4d04-9eb2-d914fa787e79 req-e6372134-148f-4e2f-8386-4df389a4a1b4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086744 Jul 18 10:50:54.616746 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 479/980] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:50:54.784818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:54.797223 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2d37f9f6-14dc-43f8-8168-1b30a1bbcb62 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.265278 Jul 18 10:50:54.798186 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 502/981] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:54 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:50:55.815930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:55.818071 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:55.823972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.824552 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.825442 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:55.825981 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:55.975869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:55.983275 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b71b5b1d-635b-439d-98f6-91ecd28befd8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.172287 Jul 18 10:50:55.983837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 480/982] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:55 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:57.000211 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:57.003769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:57.007542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.007995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.008831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:57.009268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:57.157830 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:57.166586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad442f43-9715-4f94-a3c5-4fee52db9da3 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.170157 Jul 18 10:50:57.167158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 503/983] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:56 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:58.193018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:58.193973 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:58.201094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.201737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.202896 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:58.203649 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:58.357540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:58.367757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a489cf92-2f08-4be1-9fb2-296f6b686856 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.178725 Jul 18 10:50:58.368334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 481/984] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:58 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:50:59.384332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:50:59.385037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:50:59.387384 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:50:59.392660 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.393300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.397200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:50:59.397652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:50:59.536662 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:50:59.544152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9dbca466-9128-4af5-86e9-e13dc382cb4f tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.163936 Jul 18 10:50:59.548838 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 504/985] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:50:59 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:00.563395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:00.564120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:00.566195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:00.566876 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:00.576032 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.576476 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.577357 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:00.577789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:00.727509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:00.735441 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f12ffbc0-900f-42cd-ab52-9a557f0269f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.175945 Jul 18 10:51:00.736082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 482/986] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:00 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:01.752419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:01.753061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:01.756831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=8 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:01.760921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.761391 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.762153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:01.762585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:01.898199 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:01.906699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9714cb00-00b4-4e13-b41d-489af5adc0f7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.158749 Jul 18 10:51:01.907277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 505/987] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:01 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:02.923680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:02.924439 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:02.932026 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.932474 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:02.933267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:02.933700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.077349 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.085758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5161d3b1-a0ec-4bc0-b8f4-ae236530a515 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.166207 Jul 18 10:51:03.086321 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 483/988] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:02 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:03.368195 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:03.368931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:03.375893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.377146 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.377764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.378187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.401427 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lazy-loading 'flavor' on Instance uuid 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:51:03.771300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7dbaa670-56f5-4d7e-bba9-83ec9af73b18 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "POST /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0/action" status: 202 len: 0 microversion: 2.1 time: 0.407407 Jul 18 10:51:03.775251 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 506/989] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:51:03 2022] POST /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:03.784980 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:03.790575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:03.797644 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.797844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.799458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:03.800018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:03.946005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:03.954677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-251826c1-fdef-4ce4-bc6d-3622c89e4788 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.178293 Jul 18 10:51:03.955318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 484/990] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:03 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:04.102844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:04.103547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.110325 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.116849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.116849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.116849 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.257604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:04.268571 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-75f06e48-8ad9-4834-81fe-320ff4be9a9e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.169819 Jul 18 10:51:04.269197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 507/991] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:04 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:04.973463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:04.974139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:04.981825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.982267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.983111 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:04.983565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:04.988941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:05.137257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.145301 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-623a9869-edbb-4ee3-91eb-0029a2e6ddae tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.177761 Jul 18 10:51:05.145856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 485/992] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:04 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:05.286891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:05.287510 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:05.294005 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.294439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.295200 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:05.295635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:05.428174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:05.435823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7989d77e-eb1e-42a6-85fd-7d831005be7d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.153945 Jul 18 10:51:05.436375 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 508/993] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:05 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:06.048329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-76ce6974-9946-415d-a6a6-282768c7bbab req-0fbecc68-113b-40a9-a78f-0b372adfb8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f52ba8-7488-4dd3-9426-0407f2992a82", "name": "network-vif-plugged", "status": "completed", "tag": "eb4a055a-7e36-4f3c-abdd-b93788594154"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:06.058683 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-76ce6974-9946-415d-a6a6-282768c7bbab req-0fbecc68-113b-40a9-a78f-0b372adfb8f0 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.059120 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-76ce6974-9946-415d-a6a6-282768c7bbab req-0fbecc68-113b-40a9-a78f-0b372adfb8f0 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.075059 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-76ce6974-9946-415d-a6a6-282768c7bbab req-0fbecc68-113b-40a9-a78f-0b372adfb8f0 service nova] Creating event network-vif-plugged:eb4a055a-7e36-4f3c-abdd-b93788594154 for instance a0f52ba8-7488-4dd3-9426-0407f2992a82 on hv-cinder-84617 Jul 18 10:51:06.081305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-76ce6974-9946-415d-a6a6-282768c7bbab req-0fbecc68-113b-40a9-a78f-0b372adfb8f0 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036839 Jul 18 10:51:06.081909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 486/994] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:06.164168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:06.164802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:06.171296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.172698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.173954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.175368 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.339418 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:06.347466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-366e211b-9455-41d0-8ab1-5cf584a25f3a tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.187795 Jul 18 10:51:06.348033 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 509/995] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:06 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:06.452756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:06.454071 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:06.461582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.462131 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.462975 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:06.463604 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:06.629138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:06.641652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-23ba4e11-8f9b-49cb-b1b8-1b2858fb3d77 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.188657 Jul 18 10:51:06.641652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 487/996] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:06 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:07.420895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.421554 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.428651 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.429136 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.429909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.430386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.580068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:07.585835 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-05fcae36-0fb7-4b86-ae90-0c23ef4d205e tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.169077 Jul 18 10:51:07.586406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 510/997] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:07 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:07.656368 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:07.657022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:07.664371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.664863 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.665631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:07.666068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:07.816609 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:07.827662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d102e83-bd7d-4099-aa9b-72bf799c22b1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1264 microversion: 2.1 time: 0.174887 Jul 18 10:51:07.828496 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 488/998] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:07 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:08.606703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:08.606703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:08.611557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.612194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.612992 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.613426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.754328 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:08.761725 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1772a413-63d1-4de8-b809-17603d48fa7f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.162134 Jul 18 10:51:08.763533 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 511/999] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:08 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:08.844564 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:08.845972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:08.853404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.858732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.858732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:08.858732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:08.997350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.005208 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a0c7a71b-cb0b-4748-b1d9-32b614da4311 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1450 microversion: 2.1 time: 0.164711 Jul 18 10:51:09.005807 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 489/1000] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:08 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1450 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:09.022415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:09.023029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:09.029263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.029720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.030492 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.030938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.168225 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.176583 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7572cfb4-3ade-4284-861e-2c9277de5ab7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1450 microversion: 2.1 time: 0.158057 Jul 18 10:51:09.177191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 512/1001] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:09 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1450 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:09.780235 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:09.783481 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:09.792165 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.792619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.793558 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:09.793881 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:09.973958 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:09.982101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f90560f8-6dee-4302-92cc-877e24e3ef46 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.206684 Jul 18 10:51:09.982736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 490/1002] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:09 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:10.999958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:11.000575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:11.006926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.007398 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.008164 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.008603 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.150745 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:11.159527 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ffdd27f6-a20c-4e51-b890-a1f549b3b1e3 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.163976 Jul 18 10:51:11.160421 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 513/1003] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:10 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:11.603221 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-d3b352c5-49ef-4d45-bc92-070364db86a8 req-8f673f57-da85-47c6-9908-670f718882b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0f52ba8-7488-4dd3-9426-0407f2992a82", "tag": "eb4a055a-7e36-4f3c-abdd-b93788594154"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:11.621005 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d3b352c5-49ef-4d45-bc92-070364db86a8 req-8f673f57-da85-47c6-9908-670f718882b7 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:11.621670 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-d3b352c5-49ef-4d45-bc92-070364db86a8 req-8f673f57-da85-47c6-9908-670f718882b7 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:11.636308 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-d3b352c5-49ef-4d45-bc92-070364db86a8 req-8f673f57-da85-47c6-9908-670f718882b7 service nova] Creating event network-changed:eb4a055a-7e36-4f3c-abdd-b93788594154 for instance a0f52ba8-7488-4dd3-9426-0407f2992a82 on hv-cinder-84617 Jul 18 10:51:11.642543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-d3b352c5-49ef-4d45-bc92-070364db86a8 req-8f673f57-da85-47c6-9908-670f718882b7 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047044 Jul 18 10:51:11.643736 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 491/1004] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:12.179288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:12.180386 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:12.188370 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.189055 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.190106 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:12.190699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:12.207898 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:12.375587 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:12.383895 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c3bc27d9-65b1-4a0d-8e0d-c5fd1b3c5726 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.211005 Jul 18 10:51:12.384468 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 514/1005] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:12 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:13.401794 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:13.402493 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:13.409704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.410154 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.410916 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:13.411350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:13.543303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:13.551138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1dd6b139-241f-41fb-a614-9a19dfb4c340 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.154120 Jul 18 10:51:13.559662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 492/1006] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:13 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:14.567921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:14.568541 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:14.576096 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.580550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.580550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:14.580550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:14.732345 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:14.748438 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a20f978d-7d8a-49d8-b66f-9848480baac8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.184798 Jul 18 10:51:14.749214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 515/1007] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:14 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:15.768626 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:15.769359 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:15.775920 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.776372 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:15.777176 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:15.777616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:15.917934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:15.926200 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2bc59358-983f-46cf-9669-a240a1f331d7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.162300 Jul 18 10:51:15.926840 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 493/1008] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:15 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:16.943579 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:16.944187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:16.951274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:16.951724 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:16.952474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:16.952968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:17.110991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:17.116746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-66ad50f1-044e-44ab-973c-023687506b4c tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.176994 Jul 18 10:51:17.126537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 516/1009] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:16 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:18.136503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:18.137500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:18.145126 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.145703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.146537 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.147068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.298461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:18.313492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-deb47157-1409-4bf8-833b-5f3cdec0d0dc tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1569 microversion: 2.1 time: 0.182543 Jul 18 10:51:18.314202 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 494/1010] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:18 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:18.331322 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:18.331994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:18.341172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.341671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.342454 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.342882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.662879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9ea13cb0-d9ba-4346-a165-ec4451a12330 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "POST /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0/action" status: 202 len: 0 microversion: 2.1 time: 0.335565 Jul 18 10:51:18.664159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 517/1011] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:51:18 2022] POST /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:51:18.677203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:18.677854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:18.684437 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.685100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.685856 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:18.686603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:18.851146 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:18.860848 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ad8082af-0730-480e-bc02-238d5f3d5f93 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1517 microversion: 2.1 time: 0.189080 Jul 18 10:51:18.861899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 495/1012] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:18 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:19.881258 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:19.883407 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:19.885013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:19.890186 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.890763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:19.892397 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:19.893049 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:20.006465 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-178e4684-a5e7-445c-9d55-f42e8d9e0e56 req-4a57bccb-5e47-4e18-a32e-556f796802bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "name": "network-vif-unplugged", "status": "completed", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:20.019066 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-178e4684-a5e7-445c-9d55-f42e8d9e0e56 req-4a57bccb-5e47-4e18-a32e-556f796802bc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:20.019066 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-178e4684-a5e7-445c-9d55-f42e8d9e0e56 req-4a57bccb-5e47-4e18-a32e-556f796802bc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:20.038174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.compute.server_external_events [req-178e4684-a5e7-445c-9d55-f42e8d9e0e56 req-4a57bccb-5e47-4e18-a32e-556f796802bc service nova] Unable to find a host for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0. Dropping event network-vif-unplugged {{(pid=124844) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 10:51:20.039110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-178e4684-a5e7-445c-9d55-f42e8d9e0e56 req-4a57bccb-5e47-4e18-a32e-556f796802bc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036940 Jul 18 10:51:20.039714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 496/1013] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 18 10:51:20.051066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:20.058714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-074caec1-24bd-42fb-9c58-573a5cf323fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1517 microversion: 2.1 time: 0.183755 Jul 18 10:51:20.059271 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 518/1014] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:19 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1517 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:21.085401 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:21.086042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:21.096758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:21.097229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:21.098411 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:21.099350 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:21.251150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:21.261354 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cdf4d441-acea-4099-ade6-90e350fa0be5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1519 microversion: 2.1 time: 0.186864 Jul 18 10:51:21.272037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 497/1015] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:21 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:22.281517 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:22.282861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:22.290022 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.290784 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.291620 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:22.292132 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:22.562735 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:22.570817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1b845d51-c37a-4275-9cce-dcf541cade1d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.293440 Jul 18 10:51:22.571410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 519/1016] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:22 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:23.591046 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:23.592843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:23.602011 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.605128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:23.605128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:23.605128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:24.137679 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:24.146698 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1ecf45db-0a2f-4df8-9a11-95444fe038fe tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.561239 Jul 18 10:51:24.156569 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 498/1017] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:23 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:25.164185 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:25.164796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:25.171604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:25.172061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.173141 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:25.173585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:25.402528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:25.411020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a500bab0-17b6-40c7-be11-110f02b51f6f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.251216 Jul 18 10:51:25.421311 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 520/1018] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:25 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:26.429586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:26.430950 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:26.445170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.446076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.447143 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:26.447933 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:26.684088 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:26.707674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e507b36a-9ff7-42a0-8719-83547d56f3f5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.282240 Jul 18 10:51:26.708477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 499/1019] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:26 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:27.727661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:27.728274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:27.734900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:27.735467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:27.736291 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:27.736696 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:27.907356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:27.917290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-10136a94-14ec-4abd-9db1-b1724eae5870 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.193437 Jul 18 10:51:27.927649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 521/1020] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:27 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:28.934996 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:28.935717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:28.951276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.951276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:28.951276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:28.951276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:29.190526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:29.199926 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e992cac1-5668-4f39-b384-45104709e94f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.268678 Jul 18 10:51:29.200983 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 500/1021] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:28 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:30.217553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:30.218841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:30.236784 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:30.237573 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:30.238588 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:30.239244 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:30.411247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:30.420631 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-73a49e34-efbb-448c-af42-6e0fa20d1999 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.207199 Jul 18 10:51:30.423896 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 522/1022] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:30 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:31.444444 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:31.445711 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:31.454630 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.455269 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.456214 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:31.456912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:31.600986 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:31.609391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-64a580d6-313f-4e35-b590-013ecd27baa7 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.168968 Jul 18 10:51:31.611985 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 501/1023] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:31 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:32.627633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:32.628219 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:32.637079 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.637485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.638254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:32.638850 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:32.831068 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:32.839018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d55cae74-cfc4-4c16-9e84-3359224d079f tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.216131 Jul 18 10:51:32.843546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 523/1024] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:32 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:33.857887 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:33.858615 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:33.865857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.866400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:33.867186 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:33.867627 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:33.987600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:51:33.987600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Mon Jul 18 10:51:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 (ip 10.222.0.47) !!! Jul 18 10:51:34.171380 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:34.185821 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7150a95d-ca0d-4fd4-a49e-a19f7b4fbdba tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.331849 Jul 18 10:51:34.188484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 502/1025] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:33 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:35.208018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:35.209191 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:35.220670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.221414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.222817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:35.224092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:35.376215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:35.389108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e4908e4d-d362-41d7-8748-831af33b5a39 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.188310 Jul 18 10:51:35.389699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 524/1026] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:35 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:36.410475 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:36.411773 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:36.415337 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=42 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:36.421824 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.422731 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.423705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:36.424305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:36.427565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=96 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:36.664416 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:36.674306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-32df167a-2212-49eb-9e30-5934313e18e5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.270910 Jul 18 10:51:36.676067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 503/1027] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:36 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:37.695804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:37.697831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:37.715969 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:37.716611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:37.717426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:37.717903 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:37.973298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:37.987301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-46ba4e36-eb5c-427a-ada7-6968191f7b43 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.292596 Jul 18 10:51:37.991633 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 525/1028] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:37 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:38.996643 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-a01fc70e-07f7-4376-a3b7-6cb8a3964f6b req-83b1dc3a-8095-4225-8f2b-87f03c463766 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "name": "network-vif-plugged", "status": "completed", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:39.004391 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:39.005127 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:39.016063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:39.017095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.024382 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:39.024382 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.024777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a01fc70e-07f7-4376-a3b7-6cb8a3964f6b req-83b1dc3a-8095-4225-8f2b-87f03c463766 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:39.024777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-a01fc70e-07f7-4376-a3b7-6cb8a3964f6b req-83b1dc3a-8095-4225-8f2b-87f03c463766 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:39.042275 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-a01fc70e-07f7-4376-a3b7-6cb8a3964f6b req-83b1dc3a-8095-4225-8f2b-87f03c463766 service nova] Creating event network-vif-plugged:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:51:39.051027 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-a01fc70e-07f7-4376-a3b7-6cb8a3964f6b req-83b1dc3a-8095-4225-8f2b-87f03c463766 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058970 Jul 18 10:51:39.052078 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 504/1029] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:51:39.186768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:39.196189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0f7e43d5-cfa9-4ce9-8890-03b6041086c5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.196031 Jul 18 10:51:39.197017 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 526/1030] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:38 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:39.999153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:51:39.999337 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 10:51:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:51:40.214074 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:40.214757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:40.221829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:40.222261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:40.223267 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:40.223699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:40.379967 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:40.387616 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-7f3ab68a-aad1-4fdf-8777-5c0c921ad6d5 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.178156 Jul 18 10:51:40.388180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 505/1031] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:40 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:41.405378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:41.407759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:41.414373 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:41.415037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:41.415801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:41.416402 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:41.572326 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:41.581963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d3ad1095-77ec-4ab7-91ed-4116c8b744e8 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.180363 Jul 18 10:51:41.582768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 527/1032] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:41 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:42.600095 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:42.600720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:42.611211 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:42.611941 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:42.612911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:42.613520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:42.808494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:42.819158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3a5896ab-9ab7-4c65-b235-6ec7cf886113 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.222821 Jul 18 10:51:42.821153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 506/1033] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:42 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:43.844989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:43.846358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:43.854483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:43.855015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:43.856037 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:43.856546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:44.021747 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:44.030290 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-91e17a23-2121-4c63-9f16-af6f307df6ca tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.192932 Jul 18 10:51:44.033968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 528/1034] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:43 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:45.051753 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:45.052366 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:45.067731 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:45.068300 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:45.069242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:45.070151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:45.239697 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:45.240352 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6cc898fb-5c2e-4796-9c4c-43d130bb6d44 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.192376 Jul 18 10:51:45.240972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 507/1035] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:45 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:46.259057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:46.259681 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:46.267937 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:46.268641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:46.269770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:46.271016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:46.299058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-fdfc4bc5-a206-45c9-b442-abd55f328756 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'create', calling method: .version_select at 0x7f5f0a91f8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1134055583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAf9hD+Y0ItUvCeEawc+I1639KZcsIcs02cCyLrER31WE5jIQLHWNDarENuuUHp5gA2uBghBYem43aCD09cJ33uf9xcGSIQWLBOMVs3FzwYTpFMUrp7AeB2CQleetj7CQ=="}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:46.314384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-fdfc4bc5-a206-45c9-b442-abd55f328756 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Getting quotas for project 6754afdf4fcc46fbb4014f38ae3d9b73. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:46.318579 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-fdfc4bc5-a206-45c9-b442-abd55f328756 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Getting quotas for user 4ad0be39d4374c6abb43421da6d2c722 and project 6754afdf4fcc46fbb4014f38ae3d9b73. Resources: {'key_pairs'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:46.397403 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-fdfc4bc5-a206-45c9-b442-abd55f328756 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.102250 Jul 18 10:51:46.398009 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 508/1036] 10.222.0.47 () {60 vars in 1158 bytes} [Mon Jul 18 10:51:46 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:46.421768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:46.429078 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-92328d3d-04e1-438e-a052-8acc01729cb2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.174567 Jul 18 10:51:46.429715 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 529/1037] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:46 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:46.447638 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1339803184", "imageRef": "a3d7d199-0738-4cff-9368-cd73aba4448d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1134055583", "networks": [{"uuid": "c663b7bb-3b42-45a7-b67c-63e27323ab9a"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:46.497787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] validate_networks() for [('c663b7bb-3b42-45a7-b67c-63e27323ab9a', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:51:46.873540 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:51:46.873968 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:51:46.874438 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:51:46.875600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:51:46.875992 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:51:46.885445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:46.885895 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:46.886704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:46.887140 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:46.903860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Getting quotas for project 6754afdf4fcc46fbb4014f38ae3d9b73. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:51:46.907803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Getting quotas for user 4ad0be39d4374c6abb43421da6d2c722 and project 6754afdf4fcc46fbb4014f38ae3d9b73. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:51:46.918631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:51:46.920843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a3d7d199-0738-4cff-9368-cd73aba4448d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:51:47.067162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a1328696-9d7a-4cfe-9e00-a6de8fd5134c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.623312 Jul 18 10:51:47.072696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 509/1038] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:51:47.077854 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-918ab36e-523b-4280-80cf-4f445ee1bc10 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:47.078993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-918ab36e-523b-4280-80cf-4f445ee1bc10 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:47.131449 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-918ab36e-523b-4280-80cf-4f445ee1bc10 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:47.138734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-918ab36e-523b-4280-80cf-4f445ee1bc10 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1259 microversion: 2.1 time: 0.064219 Jul 18 10:51:47.138734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 530/1039] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:47 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:51:47.447733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:47.448375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:47.455463 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.455903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.456650 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:47.457106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:47.588543 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:47.597320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-48f55579-819a-443e-9485-e2f84772caa6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1575 microversion: 2.1 time: 0.153943 Jul 18 10:51:47.597909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 510/1040] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:47 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:48.155058 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fc4ae969-fff0-4a26-92e2-19328c5998f0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:48.156385 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fc4ae969-fff0-4a26-92e2-19328c5998f0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:48.216039 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fc4ae969-fff0-4a26-92e2-19328c5998f0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:48.224032 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fc4ae969-fff0-4a26-92e2-19328c5998f0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1259 microversion: 2.1 time: 0.072895 Jul 18 10:51:48.224584 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 531/1041] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:48 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1259 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:48.614902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:48.622822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:48.622822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:48.622822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:48.623219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:48.623678 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:48.778106 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:48.787042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-806fb7c6-9041-48b7-9ee4-4cab388625be tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1562 microversion: 2.1 time: 0.174948 Jul 18 10:51:48.787610 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 511/1042] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:48 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1562 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:49.240698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:49.241317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:49.247606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:49.248047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:49.248821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:49.249250 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:49.253434 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:49.311550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:49.319157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ef27d05d-e488-47b9-8b8c-ff5f279e000a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1311 microversion: 2.1 time: 0.082212 Jul 18 10:51:49.319713 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 532/1043] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:49 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1311 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:50.337510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:50.338125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:50.347318 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:50.347764 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:50.348527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:50.348999 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:50.523584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:50.538083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-cbc84dff-98eb-4c52-b38f-1a962899d8b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.204551 Jul 18 10:51:50.539705 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 512/1044] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:50 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:51.559811 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:51.561163 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:51.571829 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.573041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.576137 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.577015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.794990 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:51.806530 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6617c0d0-b9db-4cd8-b1ba-71148dc9e359 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.251368 Jul 18 10:51:51.807912 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 533/1045] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:51 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:51.864327 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-b3d81354-7cbc-40c5-98b8-d2677d18e0e5 req-320a2df6-222a-4445-bae6-09d35db97362 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:51:51.879826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b3d81354-7cbc-40c5-98b8-d2677d18e0e5 req-320a2df6-222a-4445-bae6-09d35db97362 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:51.880560 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-b3d81354-7cbc-40c5-98b8-d2677d18e0e5 req-320a2df6-222a-4445-bae6-09d35db97362 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:51.894771 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-b3d81354-7cbc-40c5-98b8-d2677d18e0e5 req-320a2df6-222a-4445-bae6-09d35db97362 service nova] Creating event network-changed:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:51:51.903684 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-b3d81354-7cbc-40c5-98b8-d2677d18e0e5 req-320a2df6-222a-4445-bae6-09d35db97362 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046155 Jul 18 10:51:51.904568 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 513/1046] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:51:52.824957 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:52.826496 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:52.835879 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=36 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:52.837946 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:52.838588 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:52.839780 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:52.840420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:53.004469 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:53.042079 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-33a1747d-6fc1-45a9-b85d-c4583366475d tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.220937 Jul 18 10:51:53.042680 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 534/1047] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:52 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:54.067677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:54.067677 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:54.072504 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:54.073064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:54.073775 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:54.074210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:54.257022 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:54.274663 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d15c521e-9f8a-436b-a88f-8367806eea03 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.212120 Jul 18 10:51:54.274804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 514/1048] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:54 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:55.295336 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:55.298585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:55.313860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:55.313860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:55.313860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:55.313860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:55.517464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:55.525145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e7e21a93-f723-4fe6-916d-7876ae2a479b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.237642 Jul 18 10:51:55.526325 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 535/1049] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:55 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:56.546626 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:56.547277 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:56.556405 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.557191 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.563314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:56.563314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:56.742680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:56.753067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4c5b9801-e0d2-4c32-a447-88df1f7d0a1b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.213346 Jul 18 10:51:56.754251 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 515/1050] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:56 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:57.782688 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:57.783708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:57.790864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:57.791507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:57.792642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:57.793444 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:57.955544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:57.965201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4dde774c-8b9d-4a05-9de9-1b2a15ea4cab tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.195342 Jul 18 10:51:57.965781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 536/1051] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:57 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:51:58.983417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:51:58.995529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:51:58.995529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:58.995529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=10 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:51:58.995529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.995529 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:58.996064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:51:58.996064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:51:59.137311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:51:59.147245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b1460545-c4d4-4226-8be5-7b4afce416e4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.167721 Jul 18 10:51:59.148195 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 516/1052] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:51:58 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:00.163843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:00.164526 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:00.166301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=4 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:00.172025 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.174963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.174963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:00.174963 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:00.317702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:00.327501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1406f823-c411-4941-beb9-6b933d7a6e58 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.167334 Jul 18 10:52:00.328814 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 537/1053] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:00 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:01.346070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:01.346612 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:01.353147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.353603 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.354369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:01.354809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:01.490911 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:01.498356 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ba18a494-b3b6-4629-bdbf-ed44d015f284 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.157755 Jul 18 10:52:01.499717 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 517/1054] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:01 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:02.516807 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:02.517429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:02.524110 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:02.524565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:02.525358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:02.525793 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:02.788432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:02.788432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-6d82b5d1-d6d8-4e5f-9d75-2227135069de tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.166667 Jul 18 10:52:02.788432 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 538/1055] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:02 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:03.697018 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:03.697634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:03.705094 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:03.705545 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:03.706307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:03.706747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:03.877398 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:03.884897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a0d26387-84f8-4e8b-a03c-eea321e26306 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.191705 Jul 18 10:52:03.885471 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 518/1056] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:03 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:04.903682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:04.904296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:04.912047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:04.922153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:04.922153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:04.922153 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:05.048263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:05.056043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f3c49d9c-b6a4-44c6-9328-1fd0cc972f67 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.157049 Jul 18 10:52:05.056602 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 539/1057] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:04 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:05.471874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-f72d185c-ef8c-4580-81d5-881eee63c0ef req-3fca90de-9172-4f2a-8ad5-1fbba71f5fd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "name": "network-vif-plugged", "status": "completed", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:05.480594 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f72d185c-ef8c-4580-81d5-881eee63c0ef req-3fca90de-9172-4f2a-8ad5-1fbba71f5fd3 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:05.481093 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f72d185c-ef8c-4580-81d5-881eee63c0ef req-3fca90de-9172-4f2a-8ad5-1fbba71f5fd3 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:05.493023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-f72d185c-ef8c-4580-81d5-881eee63c0ef req-3fca90de-9172-4f2a-8ad5-1fbba71f5fd3 service nova] Creating event network-vif-plugged:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:52:05.497934 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-f72d185c-ef8c-4580-81d5-881eee63c0ef req-3fca90de-9172-4f2a-8ad5-1fbba71f5fd3 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030402 Jul 18 10:52:05.498498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 519/1058] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:06.073702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:06.075281 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:06.082569 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:06.083016 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:06.084009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:06.084614 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:06.219319 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:06.226993 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2e5ba423-bcf0-4be3-9368-df121c7fe3da tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.157912 Jul 18 10:52:06.227578 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 540/1059] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:06 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:07.247003 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:07.247729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:07.249974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=4 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:07.255020 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.255488 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.256242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:07.256673 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:07.260845 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=80 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:07.398578 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:07.407469 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-44c1693a-918b-4406-8ffa-61bbbc31c465 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1359 microversion: 2.1 time: 0.165117 Jul 18 10:52:07.408034 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 520/1060] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:07 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:08.426405 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:08.427173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:08.435194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.435639 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.436431 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.437574 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.572356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.580674 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-7eef6812-6623-4190-a6fc-f20305837ce9 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1550 microversion: 2.1 time: 0.160084 Jul 18 10:52:08.581485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 541/1061] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:08 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1550 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:08.597844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:08.598619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:08.605842 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.606292 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.607062 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.607496 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.753138 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.761415 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-d34e9a02-e660-4ff4-9374-da61feb9f678 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1550 microversion: 2.1 time: 0.168474 Jul 18 10:52:08.762006 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 521/1062] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:08 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1550 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:08.777445 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:08.781909 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:08.782746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Searching by: {'deleted': False, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73'} {{(pid=124843) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 10:52:08.792811 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.797498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.797498 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:08.798139 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:08.894397 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.multi_cell_list [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124843) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 10:52:08.995572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-3c2d7b53-19cf-453e-b13b-9eef8e384185 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.221871 Jul 18 10:52:08.996181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 542/1063] 10.222.0.47 () {58 vars in 1124 bytes} [Mon Jul 18 10:52:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:09.006753 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:09.007371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:09.013425 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.013877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.014885 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:09.015291 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:09.144838 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:09.152192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-042cc7a7-3fd5-4240-b5da-8ccdf919a6e5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1550 microversion: 2.1 time: 0.149384 Jul 18 10:52:09.152787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 522/1064] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:09 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:11.046481 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "007a537e-44b7-456f-aa14-e91b0a93bc3f"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:11.047585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:11.054049 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.057013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:11.057013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:11.057013 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:11.890950 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-50a0fcb3-147d-4db5-a7c9-885aa8539e51 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.847973 Jul 18 10:52:11.891543 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 543/1065] 10.222.0.47 () {60 vars in 1322 bytes} [Mon Jul 18 10:52:11 2022] POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments => generated 194 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:19.516011 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:19.517011 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:19.519990 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=5 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:19.520600 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=17 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:19.525881 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:19.526364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:19.527139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:19.527573 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:19.668499 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:19.677737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4264dac9-0cfe-4ccb-8d1d-1f5bd2b653b1 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1596 microversion: 2.1 time: 0.166232 Jul 18 10:52:19.678320 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 523/1066] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:19 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1596 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:20.645198 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1764512229", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "networks": [{"uuid": "8f9b9b2f-9f0c-4125-8d1b-5f5d98be192f"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:20.652801 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:20.698632 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] validate_networks() for [('8f9b9b2f-9f0c-4125-8d1b-5f5d98be192f', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:52:21.056605 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:52:21.057165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:52:21.057641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:52:21.068062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:52:21.068062 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:52:21.070024 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.070473 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.071264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.071692 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.089363 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Getting quotas for project a8c3be0d7a0c46d790a0eefd632a6a83. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:21.094383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Getting quotas for user 3e52648bc557407db1f2e44727fbde32 and project a8c3be0d7a0c46d790a0eefd632a6a83. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:21.108353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:52:21.109253 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:52:21.288866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f530ab0e-bdf9-43fd-b5a1-e48a78bb4b4d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647863 Jul 18 10:52:21.300293 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 544/1067] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:52:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 10:52:21.300635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2bc36c20-eb30-4f9e-80d4-1de333f078eb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:21.300635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2bc36c20-eb30-4f9e-80d4-1de333f078eb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:21.358163 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2bc36c20-eb30-4f9e-80d4-1de333f078eb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:21.367461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2bc36c20-eb30-4f9e-80d4-1de333f078eb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1214 microversion: 2.1 time: 0.071635 Jul 18 10:52:21.368509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 524/1068] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:21 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:21.943796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-37d2f8dc-ca4c-4b5f-b464-72e01bdad93e req-f7d9231d-b2bd-45d2-a17b-f644ef6470fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:21.954452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-37d2f8dc-ca4c-4b5f-b464-72e01bdad93e req-f7d9231d-b2bd-45d2-a17b-f644ef6470fc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:21.955133 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-37d2f8dc-ca4c-4b5f-b464-72e01bdad93e req-f7d9231d-b2bd-45d2-a17b-f644ef6470fc service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:21.967971 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-37d2f8dc-ca4c-4b5f-b464-72e01bdad93e req-f7d9231d-b2bd-45d2-a17b-f644ef6470fc service nova] Creating event network-changed:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:52:21.973586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-37d2f8dc-ca4c-4b5f-b464-72e01bdad93e req-f7d9231d-b2bd-45d2-a17b-f644ef6470fc service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036310 Jul 18 10:52:21.978676 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 545/1069] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:22.387137 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:22.387851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:22.395518 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:22.395972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:22.396787 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:22.397229 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:22.496744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:22.507217 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e0f8bb4c-17df-4e81-bb87-22d9e177bca2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1218 microversion: 2.1 time: 0.123674 Jul 18 10:52:22.518024 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 525/1070] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:22 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1218 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:23.526596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:23.527393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:23.538188 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:23.538915 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:23.539881 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:23.540324 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:23.544717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:23.605356 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:23.612866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2a0084e1-6ef5-43db-8929-676c684486f9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1274 microversion: 2.1 time: 0.091197 Jul 18 10:52:23.613646 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 546/1071] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:23 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:24.631135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:24.631817 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:24.638530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:24.641450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:24.641450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:24.641450 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:24.811735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:24.820428 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0e617c19-1cee-41ff-be03-17841e789790 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.193839 Jul 18 10:52:24.821233 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 526/1072] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:24 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:24.994591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1364010705"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:24.995157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:25.003277 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.003815 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.004728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.005173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.139006 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.network.security_group_api [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Adding security group c1d9d08a-084d-4b93-a024-9bd5215ea642 to port e227c64c-9772-4462-ba73-59de0ce4a3b8 Jul 18 10:52:25.554584 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-312a62f7-ee45-4465-8e04-85e8b74f6900 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action" status: 202 len: 0 microversion: 2.1 time: 0.564002 Jul 18 10:52:25.558792 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 547/1073] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:52:24 2022] POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:52:25.563766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-25327da8-e258-42bc-aa98-a32199c9a454 req-cf3a9027-1200-4046-8e79-c2c303de4b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:25.569550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:25.570113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:25.571995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:25.583890 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-25327da8-e258-42bc-aa98-a32199c9a454 req-cf3a9027-1200-4046-8e79-c2c303de4b73 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.584329 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-25327da8-e258-42bc-aa98-a32199c9a454 req-cf3a9027-1200-4046-8e79-c2c303de4b73 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.586334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.587097 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.587931 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.588306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.620088 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-25327da8-e258-42bc-aa98-a32199c9a454 req-cf3a9027-1200-4046-8e79-c2c303de4b73 service nova] Creating event network-changed:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:52:25.630467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-25327da8-e258-42bc-aa98-a32199c9a454 req-cf3a9027-1200-4046-8e79-c2c303de4b73 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071234 Jul 18 10:52:25.631076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 527/1074] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:25.665635 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2707f8f4-31ce-4a56-a832-99e8c931e3e0 req-06931576-0a0c-44f7-9680-7524ef3403c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63104a5-75fd-4e98-9bb5-7d80282e717c", "tag": "c50204e2-1d09-46e7-897a-f21ce69c12f7"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:25.679470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2707f8f4-31ce-4a56-a832-99e8c931e3e0 req-06931576-0a0c-44f7-9680-7524ef3403c8 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.679916 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2707f8f4-31ce-4a56-a832-99e8c931e3e0 req-06931576-0a0c-44f7-9680-7524ef3403c8 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.698157 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2707f8f4-31ce-4a56-a832-99e8c931e3e0 req-06931576-0a0c-44f7-9680-7524ef3403c8 service nova] Creating event network-changed:c50204e2-1d09-46e7-897a-f21ce69c12f7 for instance c63104a5-75fd-4e98-9bb5-7d80282e717c on hv-cinder-84617 Jul 18 10:52:25.712284 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2707f8f4-31ce-4a56-a832-99e8c931e3e0 req-06931576-0a0c-44f7-9680-7524ef3403c8 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051830 Jul 18 10:52:25.713521 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 528/1075] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:25.827544 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:25.840413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:25.840763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-56a20f93-674a-4072-9dbf-a270f167582f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1761 microversion: 2.1 time: 0.274560 Jul 18 10:52:25.841459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 548/1076] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:25 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1761 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:25.851389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:25.862042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.862608 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:25.866303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:25.866303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:26.013338 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:26.037199 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-39a0a312-a443-46fa-9ba1-f7701b31f1a2 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.201691 Jul 18 10:52:26.037921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 529/1077] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:25 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:27.055238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:27.055852 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:27.062866 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:27.063312 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:27.064074 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:27.064506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:27.196913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:27.205201 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b6734924-31c8-475b-a627-8c646597b116 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.154129 Jul 18 10:52:27.205753 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 549/1078] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:27 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:28.222825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:28.223370 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:28.229864 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:28.230311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:28.231068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:28.231502 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:28.357182 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:28.364524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-5307145f-2572-426f-96b3-1aac84e6f82c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.145655 Jul 18 10:52:28.365118 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 530/1079] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:28 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:29.381636 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:29.382257 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:29.388813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:29.389263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:29.390018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:29.390450 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:29.526645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:29.535053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-496718f6-0945-4313-9a74-6f233644b93b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.157196 Jul 18 10:52:29.540836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 550/1080] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:29 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:30.552668 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:30.553256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:30.559639 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:30.560091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:30.561536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:30.561979 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:30.688192 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:30.695660 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-97b97c69-78b8-4a44-a5e1-62113e4730e1 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.147333 Jul 18 10:52:30.696225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 531/1081] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:30 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:31.623546 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-6d477bf6-1b55-476b-9be4-66eb55138a8f req-862e28dd-352d-4e22-9df4-9510667b94fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63104a5-75fd-4e98-9bb5-7d80282e717c", "name": "network-vif-plugged", "status": "completed", "tag": "c50204e2-1d09-46e7-897a-f21ce69c12f7"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:31.628743 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:31.630934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:31.633577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6d477bf6-1b55-476b-9be4-66eb55138a8f req-862e28dd-352d-4e22-9df4-9510667b94fb service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:31.634047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-6d477bf6-1b55-476b-9be4-66eb55138a8f req-862e28dd-352d-4e22-9df4-9510667b94fb service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:31.645562 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-6d477bf6-1b55-476b-9be4-66eb55138a8f req-862e28dd-352d-4e22-9df4-9510667b94fb service nova] Creating event network-vif-plugged:c50204e2-1d09-46e7-897a-f21ce69c12f7 for instance c63104a5-75fd-4e98-9bb5-7d80282e717c on hv-cinder-84617 Jul 18 10:52:31.650483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-6d477bf6-1b55-476b-9be4-66eb55138a8f req-862e28dd-352d-4e22-9df4-9510667b94fb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031141 Jul 18 10:52:31.651057 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 551/1082] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:31.713386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:31.713928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:31.715869 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:31.722945 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:31.723392 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:31.724158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:31.724586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:31.857871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:31.865346 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2ee8da0b-b77f-42b2-9eca-f751464c233f tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.156021 Jul 18 10:52:31.865962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 532/1083] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:31 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:32.883429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:32.884064 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:32.891630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:32.892076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:32.892872 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:32.893306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:33.029302 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:33.036853 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-95bd9480-7338-4fdd-8a41-432fc253126a tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1314 microversion: 2.1 time: 0.158194 Jul 18 10:52:33.037406 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 552/1084] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:32 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:34.054833 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:34.055445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.062219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.062681 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.063445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.063879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.199674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:34.199674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-482709d9-13c6-47f3-b777-181ef0e3b5bb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1498 microversion: 2.1 time: 0.148322 Jul 18 10:52:34.199674 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 533/1085] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:34 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:34.987239 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:34.987768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:34.994296 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.994781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:34.995556 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:34.995994 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.021267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Going to try to terminate instance {{(pid=124843) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:35.348830 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c591fda0-228b-4ef9-8235-15b6cd913e7b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "DELETE /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 204 len: 0 microversion: 2.1 time: 0.365051 Jul 18 10:52:35.349416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 553/1086] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:34 2022] DELETE /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:52:35.358255 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:35.358850 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:35.365423 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.365876 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.366648 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:35.367081 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:35.500395 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:35.507768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ce93199a-475a-40ce-a277-73303d860cbb tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1504 microversion: 2.1 time: 0.154081 Jul 18 10:52:35.508335 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 534/1087] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:35 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:36.526074 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:36.526781 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:36.533891 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.534348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.535108 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:36.535542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:36.667287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:36.675505 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f494e9ae-0e22-45bc-bfc2-00bfa855132c tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1504 microversion: 2.1 time: 0.153707 Jul 18 10:52:36.676072 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 554/1088] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:36 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:37.314931 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-212271d1-8fcc-48ec-b8cf-e3666f161557 req-4bf288be-0840-4871-a632-0cfda2a7a675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63104a5-75fd-4e98-9bb5-7d80282e717c", "name": "network-vif-deleted", "tag": "c50204e2-1d09-46e7-897a-f21ce69c12f7"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:37.324351 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-212271d1-8fcc-48ec-b8cf-e3666f161557 req-4bf288be-0840-4871-a632-0cfda2a7a675 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.324829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-212271d1-8fcc-48ec-b8cf-e3666f161557 req-4bf288be-0840-4871-a632-0cfda2a7a675 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.336974 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-212271d1-8fcc-48ec-b8cf-e3666f161557 req-4bf288be-0840-4871-a632-0cfda2a7a675 service nova] Creating event network-vif-deleted:c50204e2-1d09-46e7-897a-f21ce69c12f7 for instance c63104a5-75fd-4e98-9bb5-7d80282e717c on hv-cinder-84617 Jul 18 10:52:37.343027 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-212271d1-8fcc-48ec-b8cf-e3666f161557 req-4bf288be-0840-4871-a632-0cfda2a7a675 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031584 Jul 18 10:52:37.343617 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 535/1089] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:52:37.694214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:37.694900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:37.703149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.703589 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.704350 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.705416 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.739823 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:37.740269 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:37.740746 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lazy-loading 'fault' on Instance uuid c63104a5-75fd-4e98-9bb5-7d80282e717c {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:52:37.781885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:37.789547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-389a45c5-c67a-4c94-a80f-af8767545eb9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 200 len: 1304 microversion: 2.1 time: 0.100230 Jul 18 10:52:37.790115 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 555/1090] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:37 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:38.808167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:38.808894 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: c63104a5-75fd-4e98-9bb5-7d80282e717c] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:38.816309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.816963 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.817737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:38.818173 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:38.833148 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] HTTP exception thrown: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Request method failure captured: Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c HTTP/1.1 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TtiMDIZNPhxZXyn0hYl3U9fweIWVcWCknHiNSO9rvMOvDIw9aQzjlRExj4deXBzKOVc2IKFTvOirE1Mhbe2_-gXKlXgegpYcnyYn_3owyeCFRsDNnZqJLHnP1xzKp_Xe_ov3n86GIhjygScXXhGo0TjmVuBa9qKjW4I2iKNM6VMYiA Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: a8c3be0d7a0c46d790a0eefd632a6a83 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:52:38.834826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a8c3be0d7a0c46d790a0eefd632a6a83"}]}] Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: a8c3be0d7a0c46d790a0eefd632a6a83 Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesActionsTest-1837630609-project Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 3e52648bc557407db1f2e44727fbde32 Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesActionsTest-1837630609-project Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. Jul 18 10:52:38.836533 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'c63104a5-75fd-4e98-9bb5-7d80282e717c'} Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:38.837830 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. Jul 18 10:52:38.839574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:38.841849 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Returning 404 to user: Instance c63104a5-75fd-4e98-9bb5-7d80282e717c could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:38.841849 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6f4c6520-eb45-4f93-a70d-cc69113d98b5 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c" status: 404 len: 111 microversion: 2.1 time: 0.032571 Jul 18 10:52:38.841849 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 536/1091] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:38 2022] GET /compute/v2.1/servers/c63104a5-75fd-4e98-9bb5-7d80282e717c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:52:38.885105 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1990293477", "imageRef": "fe4a302c-1910-414a-b564-0b0407055026", "flavorRef": "452", "networks": [{"uuid": "8f9b9b2f-9f0c-4125-8d1b-5f5d98be192f"}]}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:38.935727 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.network.neutron [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] validate_networks() for [('8f9b9b2f-9f0c-4125-8d1b-5f5d98be192f', None, None, None, None, None)] {{(pid=124843) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:52:39.525274 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Flavor limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:52:39.525698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Image limits 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:52:39.526173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Flavor pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:52:39.526581 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Image pref 0:0:0 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:52:39.526991 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.virt.hardware [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124843) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:52:39.535977 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.536425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.537249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:39.537689 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:39.554458 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Getting quotas for project a8c3be0d7a0c46d790a0eefd632a6a83. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:52:39.558377 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.quota [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Getting quotas for user 3e52648bc557407db1f2e44727fbde32 and project a8c3be0d7a0c46d790a0eefd632a6a83. Resources: {'cores', 'instances', 'ram'} {{(pid=124843) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:52:39.569677 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Going to run 1 instances... {{(pid=124843) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:52:39.571875 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fe4a302c-1910-414a-b564-0b0407055026',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124843) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:52:39.801472 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-0ad8c2ac-5c77-4718-b3f7-106f8184067e tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.920125 Jul 18 10:52:39.802104 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 556/1092] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:52:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:52:39.812175 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-f63d4ff7-1a7b-4f74-b8d1-ea11ab4aa38d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:39.812805 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-f63d4ff7-1a7b-4f74-b8d1-ea11ab4aa38d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:39.879756 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-f63d4ff7-1a7b-4f74-b8d1-ea11ab4aa38d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:39.886399 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-f63d4ff7-1a7b-4f74-b8d1-ea11ab4aa38d tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1214 microversion: 2.1 time: 0.078074 Jul 18 10:52:39.886960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 537/1093] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:39 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:40.904236 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:40.904906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:40.912698 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:40.914101 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:40.914101 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:40.914424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:40.977817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:40.986318 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-326fb380-1fa5-48d5-93e8-3ed2c9fc0291 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1218 microversion: 2.1 time: 0.086608 Jul 18 10:52:40.986864 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 557/1094] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:40 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:42.004381 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:42.005149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:42.012389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.013587 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.014525 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.015147 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.079882 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:42.092063 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4a8ae74a-f2d7-43f4-a053-9d142faeb081 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1284 microversion: 2.1 time: 0.091862 Jul 18 10:52:42.092641 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 538/1095] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:41 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:42.825123 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:42.827113 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:42.835264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.835708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:42.836476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:42.836939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.102452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-9243f276-b604-4e64-85c8-77ce64095b57 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action" status: 202 len: 0 microversion: 2.1 time: 0.280692 Jul 18 10:52:43.107659 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 558/1096] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:52:42 2022] POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 10:52:43.113547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:43.115155 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:43.128029 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:43.128810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:43.133448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.134281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.135247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.135710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.136038 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.136166 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.137018 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:43.137447 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:43.349803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:43.359203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-126a7aae-6578-40fc-9452-cfc7726848a4 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.250243 Jul 18 10:52:43.366732 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 539/1097] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:43 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:43.372862 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:43.381984 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-003fc2f5-6004-4121-a37f-781a310f2e98 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1753 microversion: 2.1 time: 0.258276 Jul 18 10:52:43.387518 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 559/1098] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:43 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1753 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:43.995000 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-9afd8a4f-e9fd-4fe5-bb7b-8e719b5dadca req-4f488fa5-774f-4df4-98d4-8497b1e0a952 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e575dcfc-7484-43c5-ab51-d26b030625ca", "tag": "2fbcb94b-a45a-4ee8-84ed-e201549de439"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:44.006851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9afd8a4f-e9fd-4fe5-bb7b-8e719b5dadca req-4f488fa5-774f-4df4-98d4-8497b1e0a952 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.010274 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-9afd8a4f-e9fd-4fe5-bb7b-8e719b5dadca req-4f488fa5-774f-4df4-98d4-8497b1e0a952 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.020485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-9afd8a4f-e9fd-4fe5-bb7b-8e719b5dadca req-4f488fa5-774f-4df4-98d4-8497b1e0a952 service nova] Creating event network-changed:2fbcb94b-a45a-4ee8-84ed-e201549de439 for instance e575dcfc-7484-43c5-ab51-d26b030625ca on hv-cinder-84617 Jul 18 10:52:44.025898 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-9afd8a4f-e9fd-4fe5-bb7b-8e719b5dadca req-4f488fa5-774f-4df4-98d4-8497b1e0a952 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034449 Jul 18 10:52:44.028127 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 540/1099] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:44.377572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:44.378242 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:44.384560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.385028 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.385825 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.386254 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.400899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:44.401535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:44.416217 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.421509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.421509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:44.421509 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:44.590886 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:44.599519 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-8cb1d10a-b683-47b7-92b1-c087db7f6577 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.225671 Jul 18 10:52:44.600476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 560/1100] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:44 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:44.632445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:44.643210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4758a986-7d11-47ab-8c9e-249d5f74619e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.247385 Jul 18 10:52:44.643962 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 541/1101] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:44 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:45.617088 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.617669 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:45.625762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.632129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.632129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.632129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.641968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:45.664829 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:45.665439 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:45.672726 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.673174 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.673944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:45.674375 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:45.818353 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:45.825924 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e8adf1e3-79ed-49a6-b1f7-fc6cb3315430 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.212782 Jul 18 10:52:45.826615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 561/1102] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:45 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:45.859364 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:45.867389 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-014b7e22-c6f0-4321-8c7c-4eb2594fdf06 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.206302 Jul 18 10:52:45.867884 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 542/1103] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:45 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:46.843697 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:46.844310 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:46.850765 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:46.851214 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:46.852023 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:46.852446 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:46.884448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:46.885091 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:46.892508 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:46.892991 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:46.893774 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:46.894215 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:47.042572 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:47.050095 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-80551301-60aa-496e-a039-cc8b3812d1fe tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.210795 Jul 18 10:52:47.050671 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 562/1104] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:46 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:47.084014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:47.093114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c94f26ab-4d16-4e15-8e87-0402379d939c tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.212381 Jul 18 10:52:47.093694 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 543/1105] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:46 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:48.066975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:48.067695 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:48.074063 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:48.074511 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:48.076052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:48.076591 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:48.110124 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:48.110735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:48.117303 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:48.117747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:48.118515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:48.118944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:48.262500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:48.270873 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a38e24cc-3aec-4794-b11f-49549a4c165b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.207682 Jul 18 10:52:48.271558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 563/1106] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:48 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:48.303625 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:48.307203 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=100 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:48.312760 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a12cbf39-01ae-4c3f-b32f-e4f900345b4a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.206540 Jul 18 10:52:48.313330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 544/1107] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:48 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:49.288043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:49.288749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:49.295365 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.295820 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.296584 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.297047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.334623 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:49.335230 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:49.342936 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.343636 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.344407 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.344905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.478419 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:49.485900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc23c917-7259-457b-8b99-f359d3a7a781 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.201856 Jul 18 10:52:49.486560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 564/1108] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:49 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:49.522319 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:49.530573 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-36262cea-6216-4925-8a14-7ef58f87498a tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.199769 Jul 18 10:52:49.535394 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 545/1109] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:49 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:49.727451 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-227e06dc-6120-48fa-a3ac-c6f575ba20a3 req-b618f9eb-dbe6-43cb-a202-184078fc5f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e575dcfc-7484-43c5-ab51-d26b030625ca", "name": "network-vif-plugged", "status": "completed", "tag": "2fbcb94b-a45a-4ee8-84ed-e201549de439"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:49.731125 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:49.732672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=6 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:49.738289 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-227e06dc-6120-48fa-a3ac-c6f575ba20a3 req-b618f9eb-dbe6-43cb-a202-184078fc5f71 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:49.738831 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-227e06dc-6120-48fa-a3ac-c6f575ba20a3 req-b618f9eb-dbe6-43cb-a202-184078fc5f71 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:49.750157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-227e06dc-6120-48fa-a3ac-c6f575ba20a3 req-b618f9eb-dbe6-43cb-a202-184078fc5f71 service nova] Creating event network-vif-plugged:2fbcb94b-a45a-4ee8-84ed-e201549de439 for instance e575dcfc-7484-43c5-ab51-d26b030625ca on hv-cinder-84617 Jul 18 10:52:49.754987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-227e06dc-6120-48fa-a3ac-c6f575ba20a3 req-b618f9eb-dbe6-43cb-a202-184078fc5f71 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031202 Jul 18 10:52:49.755560 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 565/1110] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:50.503262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:50.503876 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:50.505765 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:50.506861 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=51 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:52:50.511597 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:50.512045 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:50.513355 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:50.513793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:50.551888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:50.552470 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:50.559585 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:50.565476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:50.565476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:50.565476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:50.698539 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:50.706809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-49979468-e2eb-49eb-a22f-8fe356d78682 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1314 microversion: 2.1 time: 0.207558 Jul 18 10:52:50.707378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 546/1111] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:50 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:50.741761 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:50.749867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5027d65f-483e-4c8f-a631-f3b3d670e641 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.203365 Jul 18 10:52:50.750423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 566/1112] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:50 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:51.724258 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:51.724901 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:51.732014 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.736023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.736023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.736023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.767206 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:51.769168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:51.776145 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.776598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.777429 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:51.777860 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:51.922530 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:51.930260 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ca7748d5-4b53-4d5a-83b8-cfc75509c0c9 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1499 microversion: 2.1 time: 0.209882 Jul 18 10:52:51.930847 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 547/1113] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:51 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1499 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:51.965197 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:51.973843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-5fab8b5c-58b9-4311-a2fc-03cdc3ae3e77 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.210933 Jul 18 10:52:51.974787 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 567/1114] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:51 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:52.798027 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:52.798557 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:52.805089 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:52.805536 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:52.806296 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:52.806725 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:52.832535 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:52:52.992102 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:52.992900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:52.999965 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.000415 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.001204 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.001642 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.147772 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:53.156339 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-d4f36cab-1fe7-4325-9115-bf19ecca0adc tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.168128 Jul 18 10:52:53.156981 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 568/1115] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:52 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:53.165179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-11edfed9-7baf-49c9-b87a-b59747a4e0e8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "DELETE /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 204 len: 0 microversion: 2.1 time: 0.371170 Jul 18 10:52:53.165779 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 548/1116] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:52:52 2022] DELETE /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:52:53.175215 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:53.176031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:53.182190 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.182641 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.183399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:53.183836 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:53.314158 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:53.321816 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-f8090ce5-c680-4e3d-ac41-865f0e38b8b8 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1505 microversion: 2.1 time: 0.151101 Jul 18 10:52:53.322414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 569/1117] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:53 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:54.173854 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:54.174567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:54.181142 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.181584 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.182332 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.182757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.326877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:54.335130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-36474ba7-4ca1-4520-a40b-faca2b339a5e tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.165503 Jul 18 10:52:54.335696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 549/1118] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:54 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:54.339304 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:54.339940 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:54.346361 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.346807 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.347567 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.348000 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:54.482817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:54.490149 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-c2d4a92f-46ae-4351-91ef-92b328fcf302 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1505 microversion: 2.1 time: 0.154722 Jul 18 10:52:54.490714 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 570/1119] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:54 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1505 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:54.983760 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-04033518-748a-474d-8337-89ce9a8c9ca6 req-71f56f3f-d5ea-4cc8-8293-0061b68bc475 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e575dcfc-7484-43c5-ab51-d26b030625ca", "name": "network-vif-deleted", "tag": "2fbcb94b-a45a-4ee8-84ed-e201549de439"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:52:54.991745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-04033518-748a-474d-8337-89ce9a8c9ca6 req-71f56f3f-d5ea-4cc8-8293-0061b68bc475 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:54.992180 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-04033518-748a-474d-8337-89ce9a8c9ca6 req-71f56f3f-d5ea-4cc8-8293-0061b68bc475 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.003412 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-04033518-748a-474d-8337-89ce9a8c9ca6 req-71f56f3f-d5ea-4cc8-8293-0061b68bc475 service nova] Creating event network-vif-deleted:2fbcb94b-a45a-4ee8-84ed-e201549de439 for instance e575dcfc-7484-43c5-ab51-d26b030625ca on hv-cinder-84617 Jul 18 10:52:55.008230 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-04033518-748a-474d-8337-89ce9a8c9ca6 req-71f56f3f-d5ea-4cc8-8293-0061b68bc475 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028826 Jul 18 10:52:55.008779 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 550/1120] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:52:55.351222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:55.351818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:55.358653 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.359136 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.359894 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.360334 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.505202 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:55.512124 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:55.513128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:55.518861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-fb5068b4-5bcc-4a57-a623-1bea8f764180 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1758 microversion: 2.1 time: 0.171351 Jul 18 10:52:55.519412 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 571/1121] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:55 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:52:55.520121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.520631 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.521470 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:55.521899 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:55.592183 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e52648bc557407db1f2e44727fbde32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c3be0d7a0c46d790a0eefd632a6a83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:55.599712 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-df8dd5c2-6a33-4d3a-9236-14a763c22539 tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 200 len: 1299 microversion: 2.1 time: 0.092705 Jul 18 10:52:55.600273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 551/1122] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:55 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:52:56.535341 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:56.535975 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:56.542507 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.542965 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.543958 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.544399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.616391 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:52:56.617058 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] [instance: e575dcfc-7484-43c5-ab51-d26b030625ca] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:52:56.623886 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.628114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.628114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:52:56.628114 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:52:56.640004 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] HTTP exception thrown: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Request method failure captured: Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca HTTP/1.1 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TtiMDIZNPhxZXyn0hYl3U9fweIWVcWCknHiNSO9rvMOvDIw9aQzjlRExj4deXBzKOVc2IKFTvOirE1Mhbe2_-gXKlXgegpYcnyYn_3owyeCFRsDNnZqJLHnP1xzKp_Xe_ov3n86GIhjygScXXhGo0TjmVuBa9qKjW4I2iKNM6VMYiA Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: a8c3be0d7a0c46d790a0eefd632a6a83 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:52:56.641696 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/a8c3be0d7a0c46d790a0eefd632a6a83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/a8c3be0d7a0c46d790a0eefd632a6a83"}]}] Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: a8c3be0d7a0c46d790a0eefd632a6a83 Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-VolumesActionsTest-1837630609 Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-VolumesActionsTest-1837630609-project Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 3e52648bc557407db1f2e44727fbde32 Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-VolumesActionsTest-1837630609-project Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. Jul 18 10:52:56.643104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'e575dcfc-7484-43c5-ab51-d26b030625ca'} Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:52:56.643877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. Jul 18 10:52:56.645341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:52:56.646448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] Returning 404 to user: Instance e575dcfc-7484-43c5-ab51-d26b030625ca could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:52:56.646448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ca2aaca4-1f91-4476-89f6-cfde5868565b tempest-VolumesActionsTest-1837630609 tempest-VolumesActionsTest-1837630609-project] 10.222.0.47 "GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca" status: 404 len: 111 microversion: 2.1 time: 0.030609 Jul 18 10:52:56.646448 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 552/1123] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:56 2022] GET /compute/v2.1/servers/e575dcfc-7484-43c5-ab51-d26b030625ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:52:56.692947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:52:56.701256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-dc7e3f1e-8be8-496c-b345-5c7db19c22c4 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1761 microversion: 2.1 time: 0.169839 Jul 18 10:52:56.701817 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 572/1124] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:52:56 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:09.024867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.025490 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.028472 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:09.029565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:09.030348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-8d1fa141-6793-4e83-a393-e175dfa6c803 req-02b43633-040d-44d0-9a53-8f03db528b30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:09.037861 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:09.038672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=65 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:09.041424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8d1fa141-6793-4e83-a393-e175dfa6c803 req-02b43633-040d-44d0-9a53-8f03db528b30 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.045312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.045561 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-8d1fa141-6793-4e83-a393-e175dfa6c803 req-02b43633-040d-44d0-9a53-8f03db528b30 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.045686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.045686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.045686 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.059702 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-8d1fa141-6793-4e83-a393-e175dfa6c803 req-02b43633-040d-44d0-9a53-8f03db528b30 service nova] Creating event network-changed:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:53:09.066344 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-8d1fa141-6793-4e83-a393-e175dfa6c803 req-02b43633-040d-44d0-9a53-8f03db528b30 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039864 Jul 18 10:53:09.071270 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 573/1125] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 10:53:09.092446 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:53:09.478193 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8e3cc829-8d11-4c9f-8e66-f987cc696114 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "DELETE /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 204 len: 0 microversion: 2.1 time: 0.457376 Jul 18 10:53:09.489256 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 553/1126] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:09 2022] DELETE /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:09.491404 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:09.492392 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:09.505779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.506657 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.508313 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:09.509414 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:09.878172 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:09.888227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-57c17276-97a3-4c16-85ae-cec7bc9456e2 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.402876 Jul 18 10:53:09.890483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 574/1127] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:09 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:10.913129 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:10.913925 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:10.923976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.924959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:10.926271 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:10.926966 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:11.147544 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:11.161141 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-61a745dc-0ca0-4eec-b95a-83b1721ccbd9 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1568 microversion: 2.1 time: 0.252494 Jul 18 10:53:11.162581 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 554/1128] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:10 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:12.125300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-4445e55d-b263-4d50-95eb-2d4a2445b3e1 req-b7c425a8-a26d-4d57-a88c-cde9705a4efb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae609d7-db10-4836-ab3c-6fcaa965b5c0", "name": "network-vif-deleted", "tag": "ec97e652-9936-4418-827c-4a681c472825"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:12.140577 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4445e55d-b263-4d50-95eb-2d4a2445b3e1 req-b7c425a8-a26d-4d57-a88c-cde9705a4efb service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:12.141379 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-4445e55d-b263-4d50-95eb-2d4a2445b3e1 req-b7c425a8-a26d-4d57-a88c-cde9705a4efb service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.153464 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-4445e55d-b263-4d50-95eb-2d4a2445b3e1 req-b7c425a8-a26d-4d57-a88c-cde9705a4efb service nova] Creating event network-vif-deleted:ec97e652-9936-4418-827c-4a681c472825 for instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 on hv-cinder-84617 Jul 18 10:53:12.158615 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-4445e55d-b263-4d50-95eb-2d4a2445b3e1 req-b7c425a8-a26d-4d57-a88c-cde9705a4efb service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037260 Jul 18 10:53:12.159426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 575/1129] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:12.179290 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:12.180160 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:12.190527 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:12.191437 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.192427 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:12.193109 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:12.317169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:12.328008 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3797c31d-5057-4dcf-b38c-152ac2481ca6 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1382 microversion: 2.1 time: 0.152229 Jul 18 10:53:12.330042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 555/1130] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:12 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1382 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:13.348098 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:13.348855 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:13.355426 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:13.355888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:13.356652 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:13.357144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:13.391630 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:13.392081 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:13.392537 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.objects.instance [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lazy-loading 'fault' on Instance uuid 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 {{(pid=124843) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:13.440658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3cd9bc14a25846189a81c3a6845fd551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d89e2b7a84b4fb6ba7060088b60f6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:13.459181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-208d211d-b6ab-4fbf-be17-72665ab90064 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 200 len: 1223 microversion: 2.1 time: 0.105325 Jul 18 10:53:13.459181 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 576/1131] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:13 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 1223 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:14.467542 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:14.468371 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] [instance: 2ae609d7-db10-4836-ab3c-6fcaa965b5c0] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:14.477562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.478294 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.479071 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:14.479503 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:14.494445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] HTTP exception thrown: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Request method failure captured: Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 HTTP/1.1 Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1TpmlnEIykplTjM7P7stl7HmYS0Hbt3t_F3KRrdiseI-y-C78Y9ewtbVUT1MG1SbiEs7XAS9Dw2SFofkfzA65JwUurE3gBOfLxCKIaH1Bj0lOCFxsIIZrlmIKIGABcfRo0GMDSbevsHsPI0PpVazTqUmu0tYoAI9NmG0wEOlZWfviws Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 6d89e2b7a84b4fb6ba7060088b60f6ae Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestShelveInstance-1319972444 Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:53:14.496151 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d89e2b7a84b4fb6ba7060088b60f6ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6d89e2b7a84b4fb6ba7060088b60f6ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6d89e2b7a84b4fb6ba7060088b60f6ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6d89e2b7a84b4fb6ba7060088b60f6ae"}]}] Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestShelveInstance-1319972444 Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 6d89e2b7a84b4fb6ba7060088b60f6ae Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestShelveInstance-1319972444 Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-TestShelveInstance-1319972444-project Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: 3cd9bc14a25846189a81c3a6845fd551 Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestShelveInstance-1319972444-project Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. Jul 18 10:53:14.497790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': '2ae609d7-db10-4836-ab3c-6fcaa965b5c0'} Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:14.498655 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. Jul 18 10:53:14.500015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:53:14.502379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Returning 404 to user: Instance 2ae609d7-db10-4836-ab3c-6fcaa965b5c0 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:14.502379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-036d353f-231b-48f7-93d6-588b9b6d1156 tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0" status: 404 len: 111 microversion: 2.1 time: 0.034732 Jul 18 10:53:14.502379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 556/1132] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:14 2022] GET /compute/v2.1/servers/2ae609d7-db10-4836-ab3c-6fcaa965b5c0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:14.802885 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-65da4dc7-a6e3-4d69-98c0-d24ff6e2f89d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] Calling method '.version_select at 0x7f5f0a685ee0>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:14.906053 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-65da4dc7-a6e3-4d69-98c0-d24ff6e2f89d tempest-TestShelveInstance-1319972444 tempest-TestShelveInstance-1319972444-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-198427344" status: 202 len: 0 microversion: 2.1 time: 0.107101 Jul 18 10:53:14.906710 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 577/1133] 10.222.0.47 () {58 vars in 1250 bytes} [Mon Jul 18 10:53:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-198427344 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:17.353710 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:17.354317 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:17.367244 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.368843 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.369768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.372897 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.416870 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:53:17.907466 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-8c7915f8-1819-46c4-8d40-47cd57a5327d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 204 len: 0 microversion: 2.1 time: 0.559042 Jul 18 10:53:17.908896 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 557/1134] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:17 2022] DELETE /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:17.916547 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:17.917173 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:17.924483 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.924954 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:17.925774 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:17.926267 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:18.073989 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:18.081948 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4d98bb58-5bff-4e86-9ae0-67f403294031 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1575 microversion: 2.1 time: 0.169682 Jul 18 10:53:18.082574 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 578/1135] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:17 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:19.100330 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:19.101168 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:19.108278 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:19.108749 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:19.109725 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:19.110306 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:19.274480 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:19.283494 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6c779157-8a98-4504-98b4-518ce4504904 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1575 microversion: 2.1 time: 0.187463 Jul 18 10:53:19.284072 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 558/1136] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:19 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1575 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:20.300611 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:20.301288 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:20.307900 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.308528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.309493 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:20.309946 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:20.451616 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:20.459247 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b75e7ec5-1311-4948-9100-d6ebfab69ded tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1575 microversion: 2.1 time: 0.162588 Jul 18 10:53:20.459821 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 579/1137] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:20 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:21.319559 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-2ef56528-0fc9-4592-aa0b-0b465f3b0d05 req-e9416abf-613f-4a6a-8d58-0ca69e85b00a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0f52ba8-7488-4dd3-9426-0407f2992a82", "name": "network-vif-deleted", "tag": "eb4a055a-7e36-4f3c-abdd-b93788594154"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:21.330500 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2ef56528-0fc9-4592-aa0b-0b465f3b0d05 req-e9416abf-613f-4a6a-8d58-0ca69e85b00a service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.332871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-2ef56528-0fc9-4592-aa0b-0b465f3b0d05 req-e9416abf-613f-4a6a-8d58-0ca69e85b00a service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.344959 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-2ef56528-0fc9-4592-aa0b-0b465f3b0d05 req-e9416abf-613f-4a6a-8d58-0ca69e85b00a service nova] Creating event network-vif-deleted:eb4a055a-7e36-4f3c-abdd-b93788594154 for instance a0f52ba8-7488-4dd3-9426-0407f2992a82 on hv-cinder-84617 Jul 18 10:53:21.350075 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-2ef56528-0fc9-4592-aa0b-0b465f3b0d05 req-e9416abf-613f-4a6a-8d58-0ca69e85b00a service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034188 Jul 18 10:53:21.351222 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 559/1138] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:21.478425 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:21.484548 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:21.492785 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.493944 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.496332 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:21.496938 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:21.579333 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:21.587805 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4201b066-cc93-4924-9a0c-41bf01bcc323 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1223 microversion: 2.1 time: 0.113828 Jul 18 10:53:21.595980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 580/1139] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:21 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1223 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:22.609597 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:22.610445 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:22.624987 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.625424 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.626190 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.626828 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.669413 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:22.669680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:22.670418 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lazy-loading 'fault' on Instance uuid a0f52ba8-7488-4dd3-9426-0407f2992a82 {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:22.818477 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:22.829972 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-826d7de7-18f3-4cf5-b7c1-b184c2701fa0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 200 len: 1228 microversion: 2.1 time: 0.227473 Jul 18 10:53:22.833271 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 560/1140] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:22 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 1228 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:23.848798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:23.850169 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:23.862399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.862399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.862399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:23.862399 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:23.876566 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] HTTP exception thrown: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Request method failure captured: Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 HTTP/1.1 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Trsd4pbKJe4GajqrZRuHG04jZO6uVVIQlua7y-cC5W1UQCwuh3YlXWDkrqpEYRqujATqIQsQ1P5VNDpA9fY4CioGhbpV-jXomqYsVqTT_5KChnsG-vQU-3FiSAunLGL7Z5tugfNjPMBcsSf55anl2jyFhht1bWlrI8uv6-trF7bcuI Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:53:23.878299 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d7ee0634e694265868916311d7fb4f1"}]}] Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-320413221 Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: cf3fce0b778f46df844a6be985c28b09 Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:53:23.879769 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a0f52ba8-7488-4dd3-9426-0407f2992a82'} Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:23.880717 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:53:23.882075 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:23.883297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Returning 404 to user: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:23.883297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-eb1db356-de63-4d73-a677-b3bbaf19c999 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 404 len: 111 microversion: 2.1 time: 0.034809 Jul 18 10:53:23.883297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 581/1141] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:23 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:24.010589 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1932900398", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704550812", "security_groups": [{"name": "tempest-secgroup-smoke-1348792654"}], "block_device_mapping_v2": [{"uuid": "b3c5c48c-e477-4d55-b4f1-5fdcdff584ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3d6ab3c-79a1-4e86-be98-5fb63570bf8f"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:24.131871 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] validate_networks() for [('a3d6ab3c-79a1-4e86-be98-5fb63570bf8f', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:53:24.594524 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:53:24.595044 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:53:24.595597 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:53:24.596067 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:53:24.596777 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:53:24.607083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.607675 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.608563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:24.609261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:24.626618 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:53:24.630912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for user cf3fce0b778f46df844a6be985c28b09 and project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:53:24.687906 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:53:24.690054 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3c5c48c-e477-4d55-b4f1-5fdcdff584ad',volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:53:25.235270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b72b1a6f-9875-415b-8447-1e14f2219b6b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.228562 Jul 18 10:53:25.240857 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 561/1142] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:53:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1230 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:53:25.246582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-65569837-5237-45ce-abf3-8eb29f1c30da tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:25.255109 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-65569837-5237-45ce-abf3-8eb29f1c30da tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:25.333682 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-65569837-5237-45ce-abf3-8eb29f1c30da tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:25.341703 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-65569837-5237-45ce-abf3-8eb29f1c30da tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1094 microversion: 2.1 time: 0.099572 Jul 18 10:53:25.342654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 582/1143] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:25 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1094 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:26.360015 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:26.360626 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:26.367122 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.373691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.373691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:26.373691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:26.433246 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:26.440802 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-1d8b302a-1381-4560-b19f-42cde3f686cb tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1144 microversion: 2.1 time: 0.085883 Jul 18 10:53:26.442473 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 562/1144] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:26 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:27.458157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:27.458764 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:27.466796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.467246 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.468009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:27.468439 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:27.547686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:27.547686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4d441e78-2e39-49d8-bf16-7545683388d5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1200 microversion: 2.1 time: 0.089728 Jul 18 10:53:27.547686 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 583/1145] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:27 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1200 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:28.562708 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:28.563290 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:28.570164 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.570619 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.571400 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:28.571944 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:28.717196 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:28.725153 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-62ed1fee-7d10-400b-befd-8f998b4bd3f0 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1278 microversion: 2.1 time: 0.166960 Jul 18 10:53:28.725725 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 563/1146] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:28 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:29.517980 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-74baa386-485d-4f0a-a7c6-4549cf5879b1 req-62e40173-fc72-4975-90db-6f31d5364074 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85123212-876e-419a-9b70-fc004bda06a7", "tag": "d838ce6e-f01f-4abe-a4e4-61d1ec0603e1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:29.528165 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-74baa386-485d-4f0a-a7c6-4549cf5879b1 req-62e40173-fc72-4975-90db-6f31d5364074 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.528939 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-74baa386-485d-4f0a-a7c6-4549cf5879b1 req-62e40173-fc72-4975-90db-6f31d5364074 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.539643 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-74baa386-485d-4f0a-a7c6-4549cf5879b1 req-62e40173-fc72-4975-90db-6f31d5364074 service nova] Creating event network-changed:d838ce6e-f01f-4abe-a4e4-61d1ec0603e1 for instance 85123212-876e-419a-9b70-fc004bda06a7 on hv-cinder-84617 Jul 18 10:53:29.551157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-74baa386-485d-4f0a-a7c6-4549cf5879b1 req-62e40173-fc72-4975-90db-6f31d5364074 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030239 Jul 18 10:53:29.551532 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 584/1147] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:29.749128 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:29.750452 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:29.756803 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.757257 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.758030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:29.758461 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:29.907624 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:29.916035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-b5db1e3c-1351-40cf-b7ad-fb2b301a9b16 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.171864 Jul 18 10:53:29.918767 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 564/1148] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:29 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:30.937964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:30.937964 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:30.941786 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.942263 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:30.943031 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:30.943463 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:31.079778 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:31.087454 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b3ff7a32-3b41-437e-a1e4-1cb5b4a82f71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.157917 Jul 18 10:53:31.088015 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 585/1149] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:30 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:32.104662 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:32.105915 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:32.112566 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.113049 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.113813 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:32.114245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:32.254088 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:32.261853 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e878b1c6-82c1-488c-9eb5-9245ea844897 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.161115 Jul 18 10:53:32.262547 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 565/1150] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:32 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:33.277893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:33.278734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:33.285385 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.285837 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.286608 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:33.287041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:33.417947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:33.425460 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e977ccdc-ed44-419f-8d4e-9f2b13aa2ad1 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.151874 Jul 18 10:53:33.426020 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 586/1151] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:33 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:34.442250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:34.442758 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:34.449248 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.449700 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.450467 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:34.450902 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:34.581874 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:34.589910 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-74f66067-9e9b-45c2-b500-ca5e2b9f528a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.151546 Jul 18 10:53:34.590452 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 566/1152] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:34 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:35.265770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1364010705"}} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:35.266306 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:35.272867 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.273317 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.274073 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.274506 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.338500 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.408460 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.network.security_group_api [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Removing security group c1d9d08a-084d-4b93-a024-9bd5215ea642 from port e227c64c-9772-4462-ba73-59de0ce4a3b8 Jul 18 10:53:35.606921 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:35.607510 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:35.609520 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.610171 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.615675 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.616125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.616928 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.617378 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.794170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:35.797855 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:35.802162 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6853bfc9-e624-45b3-b54b-474ae35b6268 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.199673 Jul 18 10:53:35.802720 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 567/1153] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:35 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:35.867448 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-79e28b5a-3fc6-478d-a46f-d1562e26a361 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action" status: 202 len: 0 microversion: 2.1 time: 0.605379 Jul 18 10:53:35.868534 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 587/1154] 10.222.0.47 () {60 vars in 1277 bytes} [Mon Jul 18 10:53:35 2022] POST /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/action => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:35.877312 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-f7ab5be2-df18-416a-9a33-02ab15383a73 req-cb003a4d-4a51-41f2-83b2-74044eb86b76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:35.889942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f7ab5be2-df18-416a-9a33-02ab15383a73 req-cb003a4d-4a51-41f2-83b2-74044eb86b76 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:35.890977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-f7ab5be2-df18-416a-9a33-02ab15383a73 req-cb003a4d-4a51-41f2-83b2-74044eb86b76 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:35.910484 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-f7ab5be2-df18-416a-9a33-02ab15383a73 req-cb003a4d-4a51-41f2-83b2-74044eb86b76 service nova] Creating event network-changed:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:53:35.925759 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-f7ab5be2-df18-416a-9a33-02ab15383a73 req-cb003a4d-4a51-41f2-83b2-74044eb86b76 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052859 Jul 18 10:53:35.926369 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 568/1155] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:36.819558 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:36.820194 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:36.827756 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.828227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:36.829043 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:36.829467 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.291794 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:37.299976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-b93a8ce5-028a-455e-b3b9-7eef353d18c7 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.484418 Jul 18 10:53:37.300824 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 588/1156] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:36 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:37.501809 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:37.502492 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:37.509567 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.510130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.510903 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.511342 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.597036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.objects.instance [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lazy-loading 'services' on Instance uuid 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba {{(pid=124844) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 10:53:37.829181 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2830b399-80ea-4e0f-b5ec-67e2a275e78b tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments/007a537e-44b7-456f-aa14-e91b0a93bc3f" status: 202 len: 0 microversion: 2.1 time: 0.331343 Jul 18 10:53:37.835242 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 569/1157] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:53:37 2022] DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments/007a537e-44b7-456f-aa14-e91b0a93bc3f => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:37.844528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:37.847763 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:37.860079 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.860916 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.861851 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.862672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.904089 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-4333f113-004b-4be1-aafa-51d064132bb6 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068922 Jul 18 10:53:37.905264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 589/1158] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:37 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:37.949101 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-ed3ddcf6-ee24-4cae-993b-d94c425aef60 req-efd097a3-7a8f-4be5-b8bd-8442da3ad0ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:37.969069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ed3ddcf6-ee24-4cae-993b-d94c425aef60 req-efd097a3-7a8f-4be5-b8bd-8442da3ad0ca service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:37.969555 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-ed3ddcf6-ee24-4cae-993b-d94c425aef60 req-efd097a3-7a8f-4be5-b8bd-8442da3ad0ca service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:37.988430 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-ed3ddcf6-ee24-4cae-993b-d94c425aef60 req-efd097a3-7a8f-4be5-b8bd-8442da3ad0ca service nova] Creating event network-changed:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:53:37.995865 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-ed3ddcf6-ee24-4cae-993b-d94c425aef60 req-efd097a3-7a8f-4be5-b8bd-8442da3ad0ca service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050691 Jul 18 10:53:37.997165 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 570/1159] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:38.317944 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:38.318760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:38.325261 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.325645 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.326409 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.326841 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.503315 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:38.512586 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-55e6fae3-ff90-4b16-b6ab-9dc43f60f25d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.198257 Jul 18 10:53:38.530266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 590/1160] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:38 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:38.917065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:38.918150 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:38.925339 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.925790 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.926575 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.927016 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.959835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-c67e2b32-088e-4363-b95f-d0c79d01cd72 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047664 Jul 18 10:53:38.960426 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 571/1161] 10.222.0.47 () {58 vars in 1301 bytes} [Mon Jul 18 10:53:38 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 10:53:38.971699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:38.972268 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:38.979159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.979949 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:38.981553 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:38.982001 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.065934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] HTTP exception thrown: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba is not attached to volume 007a537e-44b7-456f-aa14-e91b0a93bc3f Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Request method failure captured: Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments/007a537e-44b7-456f-aa14-e91b0a93bc3f HTTP/1.1 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tsu5ZJeyaRLQXkZ8vavd48vXr-7uKonqx-yRFyNA4b21BEm5PedXrWogFKlz1FOWYcwNAWk_GMyoT2MB0ZVnObUypvbYvNIAsYwhu9DMnIUIgBB1zuU_UU5cwaTVvIkYURrjUhxB3NsFSp1JBQfubuCDIFmEhPvOfvthjd-Td84KXM Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 6754afdf4fcc46fbb4014f38ae3d9b73 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:53:39.068237 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6754afdf4fcc46fbb4014f38ae3d9b73"}]}] Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 6754afdf4fcc46fbb4014f38ae3d9b73 Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestMinimumBasicScenario-657196460-project Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 4ad0be39d4374c6abb43421da6d2c722 Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestMinimumBasicScenario-657196460-project Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:53:39.070092 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba is not attached to volume 007a537e-44b7-456f-aa14-e91b0a93bc3f Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'server_id': '68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba', 'id': '007a537e-44b7-456f-aa14-e91b0a93bc3f'} Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 007a537e-44b7-456f-aa14-e91b0a93bc3f. Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:39.075256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba is not attached to volume 007a537e-44b7-456f-aa14-e91b0a93bc3f Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba is not attached to volume 007a537e-44b7-456f-aa14-e91b0a93bc3f Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:39.076757 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Returning 404 to user: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba is not attached to volume 007a537e-44b7-456f-aa14-e91b0a93bc3f {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:39.078654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-ad996f60-6051-49e9-8fd9-413a409e9f35 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments/007a537e-44b7-456f-aa14-e91b0a93bc3f" status: 404 len: 154 microversion: 2.1 time: 0.102193 Jul 18 10:53:39.078654 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 591/1162] 10.222.0.47 () {58 vars in 1415 bytes} [Mon Jul 18 10:53:38 2022] DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba/os-volume_attachments/007a537e-44b7-456f-aa14-e91b0a93bc3f => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:53:39.530124 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:39.530816 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:39.532820 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:39.537595 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.538037 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.538786 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:39.539212 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:39.674433 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:39.681922 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ef24fd49-329e-4283-bf70-8d8dc8cf70c8 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.156493 Jul 18 10:53:39.682487 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 572/1163] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:39 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:40.078760 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b7adc7e4-246c-4497-9673-cf642afdecda req-275e750f-0206-4332-8ff9-257f1037a734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85123212-876e-419a-9b70-fc004bda06a7", "name": "network-vif-plugged", "status": "completed", "tag": "d838ce6e-f01f-4abe-a4e4-61d1ec0603e1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:40.083575 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.088904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b7adc7e4-246c-4497-9673-cf642afdecda req-275e750f-0206-4332-8ff9-257f1037a734 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.089348 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b7adc7e4-246c-4497-9673-cf642afdecda req-275e750f-0206-4332-8ff9-257f1037a734 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.094354 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=87 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:53:40.100968 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b7adc7e4-246c-4497-9673-cf642afdecda req-275e750f-0206-4332-8ff9-257f1037a734 service nova] Creating event network-vif-plugged:d838ce6e-f01f-4abe-a4e4-61d1ec0603e1 for instance 85123212-876e-419a-9b70-fc004bda06a7 on hv-cinder-84617 Jul 18 10:53:40.105972 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b7adc7e4-246c-4497-9673-cf642afdecda req-275e750f-0206-4332-8ff9-257f1037a734 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031488 Jul 18 10:53:40.106550 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 592/1164] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:40.354678 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.355218 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.362485 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.362930 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.363699 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.364130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.389310 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:53:40.665139 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-65d67587-2377-4e59-9602-e7812bfcc7a5 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 204 len: 0 microversion: 2.1 time: 0.314334 Jul 18 10:53:40.665735 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 573/1165] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:53:40 2022] DELETE /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:53:40.675189 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.675892 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.683040 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.683452 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.684217 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.684649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.699376 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:40.700078 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:40.707274 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.707725 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.708666 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:40.709110 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:40.886422 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:40.894731 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1f081689-06a8-4c50-a40f-76cd0e9b5963 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1556 microversion: 2.1 time: 0.224145 Jul 18 10:53:40.895297 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 593/1166] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:40 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1556 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:40.895498 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:40.903149 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-bc714872-df0c-493e-9697-54d42a85a753 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.208128 Jul 18 10:53:40.903704 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 574/1167] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:40 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:41.912041 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:41.912672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:41.919298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.919738 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:41.921102 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:41.921522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.921835 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:41.921943 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:41.928262 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.928739 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:41.929514 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:41.929947 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:42.126568 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:42.132574 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:42.134517 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-a88ef2d8-36d2-4e1f-b82c-798ad85f61a0 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1556 microversion: 2.1 time: 0.226804 Jul 18 10:53:42.135091 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 594/1168] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:41 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1556 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:42.140672 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-0a24dfa8-22de-457a-b8e4-5b7bb0acd591 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1266 microversion: 2.1 time: 0.224048 Jul 18 10:53:42.141264 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 575/1169] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:41 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:43.153872 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:43.154720 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:43.157702 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:43.158386 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:43.163672 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.164420 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.164868 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.165501 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.165658 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.165942 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.166556 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.167161 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.261476 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ad0be39d4374c6abb43421da6d2c722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6754afdf4fcc46fbb4014f38ae3d9b73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.269565 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2e00d640-ac9b-49a0-bc90-e2f3a31ac1df tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 200 len: 1514 microversion: 2.1 time: 0.119822 Jul 18 10:53:43.270176 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 595/1170] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:43 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 1514 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:53:43.335186 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.342804 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4ceb012b-b0ff-4d53-a489-0c4c5f4e7632 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1452 microversion: 2.1 time: 0.188802 Jul 18 10:53:43.343379 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 576/1171] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:43 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:43.359654 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:43.360086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:43.366280 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.366822 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.367652 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.368082 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.469649 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b508816d-7973-48ac-ba71-a817149fe037 req-dc3509f9-afe5-44c1-abd5-e7b486ecc915 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba", "name": "network-vif-deleted", "tag": "e227c64c-9772-4462-ba73-59de0ce4a3b8"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:43.477913 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b508816d-7973-48ac-ba71-a817149fe037 req-dc3509f9-afe5-44c1-abd5-e7b486ecc915 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:43.478352 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b508816d-7973-48ac-ba71-a817149fe037 req-dc3509f9-afe5-44c1-abd5-e7b486ecc915 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:43.498174 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b508816d-7973-48ac-ba71-a817149fe037 req-dc3509f9-afe5-44c1-abd5-e7b486ecc915 service nova] Creating event network-vif-deleted:e227c64c-9772-4462-ba73-59de0ce4a3b8 for instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba on hv-cinder-84617 Jul 18 10:53:43.504009 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b508816d-7973-48ac-ba71-a817149fe037 req-dc3509f9-afe5-44c1-abd5-e7b486ecc915 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232641 Jul 18 10:53:43.508318 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 596/1172] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:53:43.521975 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:53:43.530521 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2c5fb18e-1da2-4234-b6b8-2daff1975f2c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1452 microversion: 2.1 time: 0.175297 Jul 18 10:53:43.531460 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 577/1173] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:43 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1452 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:53:44.287187 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:44.287887 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] [instance: 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:53:44.294059 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.294509 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:44.295423 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:44.295986 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:44.309729 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] HTTP exception thrown: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Request method failure captured: Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba HTTP/1.1 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Tsu5ZJeyaRLQXkZ8vavd48vXr-7uKonqx-yRFyNA4b21BEm5PedXrWogFKlz1FOWYcwNAWk_GMyoT2MB0ZVnObUypvbYvNIAsYwhu9DMnIUIgBB1zuU_UU5cwaTVvIkYURrjUhxB3NsFSp1JBQfubuCDIFmEhPvOfvthjd-Td84KXM Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 6754afdf4fcc46fbb4014f38ae3d9b73 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:53:44.311906 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/6754afdf4fcc46fbb4014f38ae3d9b73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/6754afdf4fcc46fbb4014f38ae3d9b73"}]}] Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 6754afdf4fcc46fbb4014f38ae3d9b73 Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestMinimumBasicScenario-657196460 Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestMinimumBasicScenario-657196460-project Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: 4ad0be39d4374c6abb43421da6d2c722 Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestMinimumBasicScenario-657196460-project Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. Jul 18 10:53:44.313522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba'} Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:53:44.317770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. Jul 18 10:53:44.319759 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:53:44.327788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Returning 404 to user: Instance 68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:53:44.327788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-077f1fdb-6dfa-43d0-b07d-29e7cadb0b66 tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba" status: 404 len: 111 microversion: 2.1 time: 0.030915 Jul 18 10:53:44.327788 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 597/1174] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:53:44 2022] GET /compute/v2.1/servers/68e3d7d0-e6f5-4971-a7d7-98eb0cd235ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 10:53:44.328048 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-db4d0c45-43bc-408c-b40a-aa217bb1872f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] Calling method '.version_select at 0x7f5f0a7ab040>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:53:44.456556 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-db4d0c45-43bc-408c-b40a-aa217bb1872f tempest-TestMinimumBasicScenario-657196460 tempest-TestMinimumBasicScenario-657196460-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134055583" status: 202 len: 0 microversion: 2.1 time: 0.138130 Jul 18 10:53:44.457311 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 578/1175] 10.222.0.47 () {58 vars in 1271 bytes} [Mon Jul 18 10:53:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1134055583 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:53:45.437466 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-b969786e-2031-4f26-88ce-746cfeea2dc2 req-9df07bae-b0c2-457e-bdb0-30fab69784e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85123212-876e-419a-9b70-fc004bda06a7", "tag": "d838ce6e-f01f-4abe-a4e4-61d1ec0603e1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:53:45.446301 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b969786e-2031-4f26-88ce-746cfeea2dc2 req-9df07bae-b0c2-457e-bdb0-30fab69784e4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:53:45.446804 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-b969786e-2031-4f26-88ce-746cfeea2dc2 req-9df07bae-b0c2-457e-bdb0-30fab69784e4 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:53:45.458882 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-b969786e-2031-4f26-88ce-746cfeea2dc2 req-9df07bae-b0c2-457e-bdb0-30fab69784e4 service nova] Creating event network-changed:d838ce6e-f01f-4abe-a4e4-61d1ec0603e1 for instance 85123212-876e-419a-9b70-fc004bda06a7 on hv-cinder-84617 Jul 18 10:53:45.463857 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-b969786e-2031-4f26-88ce-746cfeea2dc2 req-9df07bae-b0c2-457e-bdb0-30fab69784e4 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Jul 18 10:53:45.464995 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 598/1176] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:33.103334 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:33.104086 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:33.108092 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-463064175", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-704550812", "security_groups": [{"name": "tempest-secgroup-smoke-1348792654"}], "block_device_mapping_v2": [{"uuid": "3d5159ef-972b-498f-b5c4-e5e52c41f43e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a3d6ab3c-79a1-4e86-be98-5fb63570bf8f"}]}} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:33.219134 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.network.neutron [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] validate_networks() for [('a3d6ab3c-79a1-4e86-be98-5fb63570bf8f', None, None, None, None, None)] {{(pid=124844) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 10:55:33.672586 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 10:55:33.673039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image limits 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 10:55:33.673515 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Flavor pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 10:55:33.673951 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Image pref 0:0:0 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 10:55:33.674392 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.virt.hardware [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124844) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 10:55:33.683172 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:33.683620 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:33.684417 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:33.684909 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:33.701937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 10:55:33.705862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.quota [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Getting quotas for user cf3fce0b778f46df844a6be985c28b09 and project 5d7ee0634e694265868916311d7fb4f1. Resources: {'cores', 'instances', 'ram'} {{(pid=124844) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 10:55:33.762247 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Going to run 1 instances... {{(pid=124844) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 10:55:33.764347 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3d5159ef-972b-498f-b5c4-e5e52c41f43e',volume_size=None,volume_type=None)] {{(pid=124844) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 10:55:34.155105 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [a64e1975-4bd4-48c8-9c70-c609c01a8782] AMQP server on 10.222.0.47:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 10:55:35.162064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [a64e1975-4bd4-48c8-9c70-c609c01a8782] Reconnected to AMQP server on 10.222.0.47:5672 via [amqp] client with port 46818. Jul 18 10:55:35.166100 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-4c94ec56-7eae-4a0a-97f1-2e221a870bb2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.064735 Jul 18 10:55:35.166747 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 579/1177] 10.222.0.47 () {60 vars in 1146 bytes} [Mon Jul 18 10:55:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 2066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 10:55:35.175144 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=13 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:35.175888 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=25 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:35.180893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-37346991-a642-4680-8c9e-05dd769121d2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:35.181627 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-37346991-a642-4680-8c9e-05dd769121d2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:35.237904 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-37346991-a642-4680-8c9e-05dd769121d2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:35.244899 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-37346991-a642-4680-8c9e-05dd769121d2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1093 microversion: 2.1 time: 0.071821 Jul 18 10:55:35.245800 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 599/1178] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:35 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:36.262706 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:36.263324 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:36.269614 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.270070 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:36.270837 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:36.271273 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:36.335591 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:36.343225 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-01ae7adb-9f94-44c4-ac85-524162fcdd6e tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1143 microversion: 2.1 time: 0.084864 Jul 18 10:55:36.343789 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 580/1179] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:36 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:37.360443 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:37.361114 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:37.368539 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:37.369019 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.369797 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:37.370238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:37.442783 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:37.453856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-608c9bf1-75f1-4456-a8b2-7e912e6aa2e9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1209 microversion: 2.1 time: 0.097199 Jul 18 10:55:37.466394 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 600/1180] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:37 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1209 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:38.474207 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:38.474832 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:38.482390 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.482939 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.483612 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.484039 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.618905 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:38.626745 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3772b7f2-517c-4e5a-812a-cd3caa871c71 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1277 microversion: 2.1 time: 0.156401 Jul 18 10:55:38.627307 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 581/1181] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:38 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:38.955947 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-bc1e61c6-74d1-4bf1-8355-f333ae79d67d req-3f98aab4-45dd-406d-ac6e-2f81e6c20c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98405698-59ad-4dbf-89c0-c29b6f9d0058", "tag": "97efd18a-87c3-4d17-9dd6-36faa3e80aa1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:38.968266 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-bc1e61c6-74d1-4bf1-8355-f333ae79d67d req-3f98aab4-45dd-406d-ac6e-2f81e6c20c2f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:38.968768 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-bc1e61c6-74d1-4bf1-8355-f333ae79d67d req-3f98aab4-45dd-406d-ac6e-2f81e6c20c2f service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:38.981598 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-bc1e61c6-74d1-4bf1-8355-f333ae79d67d req-3f98aab4-45dd-406d-ac6e-2f81e6c20c2f service nova] Creating event network-changed:97efd18a-87c3-4d17-9dd6-36faa3e80aa1 for instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 on hv-cinder-84617 Jul 18 10:55:38.986675 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-bc1e61c6-74d1-4bf1-8355-f333ae79d67d req-3f98aab4-45dd-406d-ac6e-2f81e6c20c2f service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035258 Jul 18 10:55:38.987528 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 601/1182] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:39.642976 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:39.643583 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:39.650862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.651309 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.652102 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:39.652538 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:39.783030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:39.791879 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-057bae25-7fbb-484d-9121-3ac8bc13edda tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.152811 Jul 18 10:55:39.792542 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 582/1183] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:39 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:40.811358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:40.812090 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:40.818287 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.818734 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.819691 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:40.820129 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:40.953856 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:40.961832 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1206aba1-d825-4f99-8de7-6fd37378c28b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.155149 Jul 18 10:55:40.962389 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 602/1184] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:40 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 10:55:41.978636 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:41.979314 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:41.985733 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:41.986169 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:41.986919 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:41.987341 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:42.116043 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:42.123383 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-3cad9c28-524a-488d-903e-675e46ff7d3d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.148730 Jul 18 10:55:42.123937 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 583/1185] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:41 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:43.140371 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:43.141038 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:43.148402 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.148883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.149631 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:43.150076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:43.285178 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:43.292796 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-915c34a3-e01a-4d3a-a498-fa69cec7e49a tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.156257 Jul 18 10:55:43.293354 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 603/1186] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:43 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:44.309345 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:44.310035 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:44.312333 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=2 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:44.313152 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell0:SELECT=6 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:44.317793 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.318245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.319270 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:44.319703 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:44.447337 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:44.454977 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-47c6a318-79b9-4243-a51b-5523b57358fd tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.149490 Jul 18 10:55:44.455532 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 584/1187] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:44 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:45.471979 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:45.472596 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:45.475629 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell0:SELECT=2 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:55:45.480383 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.480876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.481637 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:45.482076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:45.613870 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:45.621798 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-213a4a84-6657-4b78-b2f5-a858671af56c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.153789 Jul 18 10:55:45.622359 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 604/1188] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:45 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:46.638513 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:46.639261 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:46.645816 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:46.646404 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:46.647276 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:46.647714 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:46.782797 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:46.790001 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-97202aea-6e67-453e-b9ac-2facb6d6414d tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.155371 Jul 18 10:55:46.790580 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 585/1189] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:46 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:47.806893 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:47.807508 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:47.813812 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:47.814264 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:47.815021 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:47.815459 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:47.945246 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:47.952876 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1affa8eb-04f3-4a1e-ac09-aa6aa4a48e99 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.149833 Jul 18 10:55:47.953436 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 605/1190] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:47 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:48.880098 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [req-dea079b9-0b2c-4d2c-8b8a-f820c6ca943e req-3a1f6436-eaaf-4b61-abb1-54bd27c8defe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98405698-59ad-4dbf-89c0-c29b6f9d0058", "name": "network-vif-plugged", "status": "completed", "tag": "97efd18a-87c3-4d17-9dd6-36faa3e80aa1"}]} {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:48.888250 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-dea079b9-0b2c-4d2c-8b8a-f820c6ca943e req-3a1f6436-eaaf-4b61-abb1-54bd27c8defe service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:48.888707 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [req-dea079b9-0b2c-4d2c-8b8a-f820c6ca943e req-3a1f6436-eaaf-4b61-abb1-54bd27c8defe service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:48.899998 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.compute.server_external_events [req-dea079b9-0b2c-4d2c-8b8a-f820c6ca943e req-3a1f6436-eaaf-4b61-abb1-54bd27c8defe service nova] Creating event network-vif-plugged:97efd18a-87c3-4d17-9dd6-36faa3e80aa1 for instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 on hv-cinder-84617 Jul 18 10:55:48.905023 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [req-dea079b9-0b2c-4d2c-8b8a-f820c6ca943e req-3a1f6436-eaaf-4b61-abb1-54bd27c8defe service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149117 Jul 18 10:55:48.905607 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 586/1191] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:55:48.970255 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:48.970897 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:48.977996 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:48.979401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:48.979401 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:48.979619 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:49.116582 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:49.124491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-72e93fe5-7053-430c-83e1-9d3753e4d98c tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.157927 Jul 18 10:55:49.125087 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 606/1192] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:48 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:50.142744 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:50.143362 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:50.151268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:50.151268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:50.151268 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:50.151561 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:50.287634 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:50.295209 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-93f5ad61-aba5-4c8a-9df0-5f4d59211fc5 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1265 microversion: 2.1 time: 0.157276 Jul 18 10:55:50.295771 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 587/1193] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:50 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:51.311320 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:51.311941 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:51.318935 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.319474 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.320241 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.320693 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.455843 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:51.464044 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-e1d90414-eece-4aa1-8509-ef8ffbeb4083 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1452 microversion: 2.1 time: 0.156568 Jul 18 10:55:51.464597 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 607/1194] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:51 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:51.480104 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:55:51.480729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:55:51.487083 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.487526 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.488281 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:51.488737 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:51.618041 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:55:51.625499 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-47b26b9b-172f-407f-b0a3-3412ffe9b231 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1452 microversion: 2.1 time: 0.149154 Jul 18 10:55:51.626064 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 588/1195] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:55:51 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:55:53.778770 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-c6ff53be-0844-4b0a-b4da-3b412a45849d req-d62abd70-5df1-47cc-9f15-aeb207bb8762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98405698-59ad-4dbf-89c0-c29b6f9d0058", "tag": "97efd18a-87c3-4d17-9dd6-36faa3e80aa1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:55:53.787076 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-c6ff53be-0844-4b0a-b4da-3b412a45849d req-d62abd70-5df1-47cc-9f15-aeb207bb8762 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:55:53.787522 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-c6ff53be-0844-4b0a-b4da-3b412a45849d req-d62abd70-5df1-47cc-9f15-aeb207bb8762 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:55:53.798163 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-c6ff53be-0844-4b0a-b4da-3b412a45849d req-d62abd70-5df1-47cc-9f15-aeb207bb8762 service nova] Creating event network-changed:97efd18a-87c3-4d17-9dd6-36faa3e80aa1 for instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 on hv-cinder-84617 Jul 18 10:55:53.803161 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-c6ff53be-0844-4b0a-b4da-3b412a45849d req-d62abd70-5df1-47cc-9f15-aeb207bb8762 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027904 Jul 18 10:55:53.803749 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 608/1196] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:56:39.844191 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:56:39.844834 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Mon Jul 18 10:56:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:57:33.554030 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:33.555069 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG dbcounter [-] [124844] Writing DB stats nova_cell1:SELECT=52 {{(pid=124844) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:33.556501 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_api:SELECT=22 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:33.557400 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG dbcounter [-] [124843] Writing DB stats nova_cell1:SELECT=46 {{(pid=124843) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 10:57:33.559170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:33.559853 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:33.564739 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-d5b7ed75-2585-4d4d-aecb-05440f3b8bfa req-f43a2f75-571a-4997-b74a-d3bef2af7947 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98405698-59ad-4dbf-89c0-c29b6f9d0058", "tag": "97efd18a-87c3-4d17-9dd6-36faa3e80aa1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:33.566121 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.566682 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.567523 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.568017 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.573952 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d5b7ed75-2585-4d4d-aecb-05440f3b8bfa req-f43a2f75-571a-4997-b74a-d3bef2af7947 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.581393 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-d5b7ed75-2585-4d4d-aecb-05440f3b8bfa req-f43a2f75-571a-4997-b74a-d3bef2af7947 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.586256 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-d5b7ed75-2585-4d4d-aecb-05440f3b8bfa req-f43a2f75-571a-4997-b74a-d3bef2af7947 service nova] Creating event network-changed:97efd18a-87c3-4d17-9dd6-36faa3e80aa1 for instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 on hv-cinder-84617 Jul 18 10:57:33.591300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-d5b7ed75-2585-4d4d-aecb-05440f3b8bfa req-f43a2f75-571a-4997-b74a-d3bef2af7947 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036798 Jul 18 10:57:33.592083 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 609/1197] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:33.594482 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:33.976219 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-a0bb97bc-d0c0-426c-8f94-f6a8d0222fc2 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "DELETE /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 204 len: 0 microversion: 2.1 time: 0.424258 Jul 18 10:57:33.977167 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 589/1198] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:33 2022] DELETE /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:57:33.987802 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:33.988635 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:33.997047 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.997847 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:33.998844 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:33.999281 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:34.139813 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:34.147592 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-1808fe28-5be6-4f25-a86f-1ea47c23b482 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1577 microversion: 2.1 time: 0.165246 Jul 18 10:57:34.148159 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 610/1199] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:33 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:35.167036 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:35.167757 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:35.175862 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:35.176582 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:35.177419 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:35.177860 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:35.315748 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:35.323478 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-6a6ae916-faf7-4026-9dd9-4ececb2b6016 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1458 microversion: 2.1 time: 0.161017 Jul 18 10:57:35.324042 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 590/1200] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:35 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1458 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:35.990803 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-3db044e2-1b8f-4edc-af44-4a09ef6e11be req-420e3433-7d47-431b-adf8-2d750b722f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98405698-59ad-4dbf-89c0-c29b6f9d0058", "name": "network-vif-deleted", "tag": "97efd18a-87c3-4d17-9dd6-36faa3e80aa1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:35.999491 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3db044e2-1b8f-4edc-af44-4a09ef6e11be req-420e3433-7d47-431b-adf8-2d750b722f1d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:36.000238 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-3db044e2-1b8f-4edc-af44-4a09ef6e11be req-420e3433-7d47-431b-adf8-2d750b722f1d service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:36.011840 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-3db044e2-1b8f-4edc-af44-4a09ef6e11be req-420e3433-7d47-431b-adf8-2d750b722f1d service nova] Creating event network-vif-deleted:97efd18a-87c3-4d17-9dd6-36faa3e80aa1 for instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 on hv-cinder-84617 Jul 18 10:57:36.017661 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-3db044e2-1b8f-4edc-af44-4a09ef6e11be req-420e3433-7d47-431b-adf8-2d750b722f1d service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029785 Jul 18 10:57:36.018250 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 611/1201] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:36.341562 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:36.342960 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:36.350170 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:36.350906 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:36.351691 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:36.352130 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:36.415768 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:36.424851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-61aba9d9-ab9a-44f8-8c67-0f639f0c7899 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 200 len: 1224 microversion: 2.1 time: 0.085939 Jul 18 10:57:36.424851 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 591/1202] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:36 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:37.440339 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:37.441061 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 98405698-59ad-4dbf-89c0-c29b6f9d0058] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:37.447719 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:37.448168 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:37.448956 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:37.449395 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:37.463298 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] HTTP exception thrown: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Request method failure captured: Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 HTTP/1.1 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Trsd4pbKJe4GajqrZRuHG04jZO6uVVIQlua7y-cC5W1UQCwuh3YlXWDkrqpEYRqujATqIQsQ1P5VNDpA9fY4CioGhbpV-jXomqYsVqTT_5KChnsG-vQU-3FiSAunLGL7Z5tugfNjPMBcsSf55anl2jyFhht1bWlrI8uv6-trF7bcuI Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:57:37.464921 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d7ee0634e694265868916311d7fb4f1"}]}] Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: cf3fce0b778f46df844a6be985c28b09 Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. Jul 18 10:57:37.466737 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '98405698-59ad-4dbf-89c0-c29b6f9d0058'} Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:37.467858 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. Jul 18 10:57:37.469670 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:37.471877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Returning 404 to user: Instance 98405698-59ad-4dbf-89c0-c29b6f9d0058 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:37.471877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-2a0f7241-2c6b-4425-af56-fb217c5d4b46 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058" status: 404 len: 111 microversion: 2.1 time: 0.030440 Jul 18 10:57:37.471877 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 612/1203] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:37 2022] GET /compute/v2.1/servers/98405698-59ad-4dbf-89c0-c29b6f9d0058 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:41.184210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:41.185421 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:41.185878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-43aef742-5ea7-4a9e-a0ef-53d38300fe76 req-79459ed2-0079-40d2-89dc-0019e16492b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85123212-876e-419a-9b70-fc004bda06a7", "tag": "d838ce6e-f01f-4abe-a4e4-61d1ec0603e1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:41.192844 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:41.193563 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:41.194344 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:41.194765 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:41.195976 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-43aef742-5ea7-4a9e-a0ef-53d38300fe76 req-79459ed2-0079-40d2-89dc-0019e16492b5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:41.196485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-43aef742-5ea7-4a9e-a0ef-53d38300fe76 req-79459ed2-0079-40d2-89dc-0019e16492b5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:41.209378 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-43aef742-5ea7-4a9e-a0ef-53d38300fe76 req-79459ed2-0079-40d2-89dc-0019e16492b5 service nova] Creating event network-changed:d838ce6e-f01f-4abe-a4e4-61d1ec0603e1 for instance 85123212-876e-419a-9b70-fc004bda06a7 on hv-cinder-84617 Jul 18 10:57:41.215300 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-43aef742-5ea7-4a9e-a0ef-53d38300fe76 req-79459ed2-0079-40d2-89dc-0019e16492b5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033424 Jul 18 10:57:41.216424 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 613/1204] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:41.226713 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Going to try to terminate instance {{(pid=124844) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 10:57:41.568912 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-594b4cb9-65df-4ef4-a248-0b80b8a96d10 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "DELETE /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 204 len: 0 microversion: 2.1 time: 0.389307 Jul 18 10:57:41.570007 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 592/1205] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:41 2022] DELETE /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 10:57:41.578779 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:41.584557 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:41.586485 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:41.587035 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:41.587886 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:41.588396 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:41.729458 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.policy [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124843) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:41.737848 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-02902263-ad9a-4291-94bc-c47b9df443b4 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1576 microversion: 2.1 time: 0.163544 Jul 18 10:57:41.738358 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 614/1206] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:41 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:42.756245 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:42.757125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:42.764384 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:42.764877 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:42.765687 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:42.766125 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:42.901179 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:42.908651 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-e6730961-b69b-4c60-a8de-5dac4c82663b tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1576 microversion: 2.1 time: 0.156711 Jul 18 10:57:42.909177 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 593/1207] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:42 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:43.622052 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [req-7c85737a-f432-43d8-b17b-c69afe632014 req-ce04e39f-bdd7-47a5-b781-1e8d6d8346e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85123212-876e-419a-9b70-fc004bda06a7", "name": "network-vif-deleted", "tag": "d838ce6e-f01f-4abe-a4e4-61d1ec0603e1"}]} {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 10:57:43.631699 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7c85737a-f432-43d8-b17b-c69afe632014 req-ce04e39f-bdd7-47a5-b781-1e8d6d8346e5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:43.632140 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [req-7c85737a-f432-43d8-b17b-c69afe632014 req-ce04e39f-bdd7-47a5-b781-1e8d6d8346e5 service nova] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:43.643473 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.compute.server_external_events [req-7c85737a-f432-43d8-b17b-c69afe632014 req-ce04e39f-bdd7-47a5-b781-1e8d6d8346e5 service nova] Creating event network-vif-deleted:d838ce6e-f01f-4abe-a4e4-61d1ec0603e1 for instance 85123212-876e-419a-9b70-fc004bda06a7 on hv-cinder-84617 Jul 18 10:57:43.648222 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [req-7c85737a-f432-43d8-b17b-c69afe632014 req-ce04e39f-bdd7-47a5-b781-1e8d6d8346e5 service nova] 10.222.0.47 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029926 Jul 18 10:57:43.648822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 615/1208] 10.222.0.47 () {64 vars in 1317 bytes} [Mon Jul 18 10:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 10:57:43.926210 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:43.926825 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:43.933606 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:43.934068 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:43.934867 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:43.935305 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:44.002430 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.policy [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf3fce0b778f46df844a6be985c28b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d7ee0634e694265868916311d7fb4f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124844) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 10:57:44.010158 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-82c0c77e-628b-409a-a9a5-0ab066a30563 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 200 len: 1225 microversion: 2.1 time: 0.088321 Jul 18 10:57:44.010729 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 594/1209] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:43 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 10:57:45.028152 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.028883 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: 85123212-876e-419a-9b70-fc004bda06a7] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.035822 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.036273 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.037066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.037503 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.051163 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] HTTP exception thrown: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Request method failure captured: Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 HTTP/1.1 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Trsd4pbKJe4GajqrZRuHG04jZO6uVVIQlua7y-cC5W1UQCwuh3YlXWDkrqpEYRqujATqIQsQ1P5VNDpA9fY4CioGhbpV-jXomqYsVqTT_5KChnsG-vQU-3FiSAunLGL7Z5tugfNjPMBcsSf55anl2jyFhht1bWlrI8uv6-trF7bcuI Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:57:45.052810 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d7ee0634e694265868916311d7fb4f1"}]}] Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: cf3fce0b778f46df844a6be985c28b09 Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. Jul 18 10:57:45.054514 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': '85123212-876e-419a-9b70-fc004bda06a7'} Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:45.055542 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. Jul 18 10:57:45.056926 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.061878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Returning 404 to user: Instance 85123212-876e-419a-9b70-fc004bda06a7 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:45.061878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-317d7e4f-8cc6-4e05-a15c-1c47dc6da7d6 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7" status: 404 len: 111 microversion: 2.1 time: 0.030860 Jul 18 10:57:45.061878 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 616/1210] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:45 2022] GET /compute/v2.1/servers/85123212-876e-419a-9b70-fc004bda06a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:45.596982 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.597588 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.compute.api [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124844) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.604458 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.604942 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.605701 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.606135 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG oslo_concurrency.lockutils [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124844) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.619367 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.wsgi [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] HTTP exception thrown: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Request method failure captured: Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: request: DELETE /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 HTTP/1.1 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept: application/json Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Accept-Encoding: identity Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Connection: close Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Length: 0 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Content-Type: application/json Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Host: 10.222.0.47 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Openstack-System-Scope: None Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Auth-Token: gAAAAABi1Trsd4pbKJe4GajqrZRuHG04jZO6uVVIQlua7y-cC5W1UQCwuh3YlXWDkrqpEYRqujATqIQsQ1P5VNDpA9fY4CioGhbpV-jXomqYsVqTT_5KChnsG-vQU-3FiSAunLGL7Z5tugfNjPMBcsSf55anl2jyFhht1bWlrI8uv6-trF7bcuI Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Id: None Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Domain-Name: None Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Identity-Status: Confirmed Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Is-Admin-Project: True Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Id: default Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Domain-Name: Default Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Project-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Role: reader,member Jul 18 10:57:45.621065 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Roles: reader,member Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d7ee0634e694265868916311d7fb4f1"}]}] Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-Tenant-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Id: default Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Domain-Name: Default Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Id: cf3fce0b778f46df844a6be985c28b09 Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: X-User-Name: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: method: > Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: exception: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.622766 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: action_args: {'id': 'a0f52ba8-7488-4dd3-9426-0407f2992a82'} Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:45.623826 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.625577 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.627846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Returning 404 to user: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. {{(pid=124844) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:45.627846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-ba8a7444-bfa2-43fe-b9ee-28c9224d6d59 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "DELETE /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jul 18 10:57:45.627846 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 595/1211] 10.222.0.47 () {58 vars in 1238 bytes} [Mon Jul 18 10:57:45 2022] DELETE /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:45.633114 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '>' {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:45.633728 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.compute.api [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] [instance: a0f52ba8-7488-4dd3-9426-0407f2992a82] Fetching instance by UUID {{(pid=124843) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 10:57:45.639765 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.640213 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.640998 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 10:57:45.642155 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG oslo_concurrency.lockutils [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Lock "6a78ea71-f9a3-4be8-8869-eba1a93328a9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124843) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 10:57:45.655410 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.wsgi [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] HTTP exception thrown: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Request method failure captured: Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: request: GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 HTTP/1.1 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept: application/json Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Accept-Encoding: identity Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Connection: close Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Length: 0 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Content-Type: application/json Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Host: 10.222.0.47 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Openstack-System-Scope: None Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: User-Agent: python-urllib3/1.26.9 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Auth-Token: gAAAAABi1Trsd4pbKJe4GajqrZRuHG04jZO6uVVIQlua7y-cC5W1UQCwuh3YlXWDkrqpEYRqujATqIQsQ1P5VNDpA9fY4CioGhbpV-jXomqYsVqTT_5KChnsG-vQU-3FiSAunLGL7Z5tugfNjPMBcsSf55anl2jyFhht1bWlrI8uv6-trF7bcuI Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Id: None Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Domain-Name: None Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Identity-Status: Confirmed Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Is-Admin-Project: True Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Id: default Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Domain-Name: Default Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Project-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Role: reader,member Jul 18 10:57:45.657066 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Roles: reader,member Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.47:8080", "publicURL": "http://10.222.0.47:8080/v1/AUTH_5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/volume/v3/5d7ee0634e694265868916311d7fb4f1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.47/compute/v2/5d7ee0634e694265868916311d7fb4f1"}]}] Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Id: 5d7ee0634e694265868916311d7fb4f1 Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-Tenant-Name: tempest-TestVolumeBootPattern-320413221 Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Id: default Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Domain-Name: Default Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Id: cf3fce0b778f46df844a6be985c28b09 Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: X-User-Name: tempest-TestVolumeBootPattern-320413221-project Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: method: > Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: exception: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.658818 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: action_args: {'id': 'a0f52ba8-7488-4dd3-9426-0407f2992a82'} Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: {{(pid=124843) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 10:57:45.659762 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. Jul 18 10:57:45.661157 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: ERROR nova.api.openstack.wsgi Jul 18 10:57:45.662357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: DEBUG nova.api.openstack.wsgi [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Returning 404 to user: Instance a0f52ba8-7488-4dd3-9426-0407f2992a82 could not be found. {{(pid=124843) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 10:57:45.662357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO nova.api.openstack.requestlog [None req-63f8fb81-bba0-42b5-9b99-1891123bd658 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82" status: 404 len: 111 microversion: 2.1 time: 0.029318 Jul 18 10:57:45.662357 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: [pid: 124843|app: 0|req: 617/1212] 10.222.0.47 () {58 vars in 1235 bytes} [Mon Jul 18 10:57:45 2022] GET /compute/v2.1/servers/a0f52ba8-7488-4dd3-9426-0407f2992a82 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 10:57:47.196565 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: DEBUG nova.api.openstack.wsgi [None req-2c5fe078-dd51-4217-8dc4-fe4685d35bf9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] Calling method '.version_select at 0x7f5f0a9a8ca0>' {{(pid=124844) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 10:57:47.302076 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO nova.api.openstack.requestlog [None req-2c5fe078-dd51-4217-8dc4-fe4685d35bf9 tempest-TestVolumeBootPattern-320413221 tempest-TestVolumeBootPattern-320413221-project] 10.222.0.47 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-704550812" status: 202 len: 0 microversion: 2.1 time: 0.109349 Jul 18 10:57:47.302680 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: [pid: 124844|app: 0|req: 596/1213] 10.222.0.47 () {58 vars in 1259 bytes} [Mon Jul 18 10:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-704550812 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 10:58:20.016990 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:58:20.017489 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 10:58:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 10:58:24.492708 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 10:58:24.493397 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 10:58:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:00:27.805249 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:00:27.805934 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 11:00:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:01:34.007000 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:01:34.007647 dv-cinder-846171-2-iscsi devstack@n-api.service[124844]: Mon Jul 18 11:01:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:01:40.024987 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:01:40.025604 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 11:01:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 11:01:44.500606 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 11:01:44.501227 dv-cinder-846171-2-iscsi devstack@n-api.service[124843]: Mon Jul 18 11:01:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!